-- Logs begin at Tue 2021-05-25 14:59:02 UTC, end at Tue 2021-05-25 15:58:26 UTC. -- May 25 15:31:44.079576 dv-cinder-791239-3-iscsi systemd[1]: Started Devstack devstack@q-svc.service. May 25 15:31:45.072618 dv-cinder-791239-3-iscsi neutron-server[98355]: Beware of the coming changes in the project packaging May 25 15:31:45.073178 dv-cinder-791239-3-iscsi neutron-server[98355]: https://github.com/svinota/pyroute2/discussions/786 May 25 15:31:46.545988 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.common.config [-] Logging enabled! May 25 15:31:46.546611 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 15:31:46.546750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98355) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 15:31:46.550029 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.common.config [-] Logging enabled! May 25 15:31:46.550292 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 15:31:46.550605 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=98355) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 15:31:46.551527 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:31:46.551765 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:31:46.552151 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:31:46.552408 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:31:46.552768 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:31:46.553102 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.553404 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.553705 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.553938 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.554239 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.554533 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.554820 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.555113 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.555418 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.555704 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.556012 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.556303 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.556539 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.556825 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] config_source = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.557114 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.557407 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.557637 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] debug = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.557923 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.558350 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.558768 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.559051 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.559346 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.559630 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.559924 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.560241 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.560526 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.560860 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] host = dv-cinder-791239-3-iscsi {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.561141 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.561432 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.561722 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.562011 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.562288 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.562572 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.562862 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.563135 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_dir = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.563411 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.563692 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.564006 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.564297 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.564595 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.565336 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.565570 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.565864 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.566154 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.566433 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.566712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.566990 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.567267 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.567544 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.567817 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.568131 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.568419 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.568707 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.568986 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.569264 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.569536 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.569810 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.570095 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.570373 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.570649 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.570926 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.571215 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.571487 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.571762 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.572096 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.572385 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.572669 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.572963 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.573239 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.573522 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.573798 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.574076 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_journal = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.574350 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_json = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.574622 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.574896 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.575178 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.575451 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.575724 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.576038 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.576316 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.576601 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:46.576902 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.577203 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.577507 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.577793 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.578092 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.578377 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.578671 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.578955 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.579247 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.579537 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.579828 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.580143 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.580532 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.581359 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.581606 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.581917 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.582217 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.582515 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.582796 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.583079 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.583357 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.583639 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.583956 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.584256 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.584552 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.584831 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.585112 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.585406 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.585688 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.585964 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.586243 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.586535 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.586818 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.587096 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.587382 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.587665 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.587968 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.588249 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.588530 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.588823 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.589104 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.589378 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.589651 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.589932 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.590209 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.590499 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.590785 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.591065 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.591340 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.591624 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.591926 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.592206 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.592487 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.592764 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.593050 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.593326 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.593602 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.593879 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.594155 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.594428 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.594703 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.594979 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.595259 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.595534 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.595812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.596138 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.596418 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.596696 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.596986 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.597285 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.597571 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.597854 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.598142 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.598424 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.598706 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.598986 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.599270 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.599553 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.599833 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.600154 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.600446 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.600736 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.601025 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.601309 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.601609 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.601891 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.602178 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.602459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.602742 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.603043 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.603334 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.603631 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.603955 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.604256 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.604553 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.604852 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.605137 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.605455 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.605741 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:46.605966 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:31:46.606269 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=98355) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 25 15:31:46.972124 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=98355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:46.972408 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=98355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:46.972702 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=98355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:31:46.973186 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [-] Loading core plugin: ml2 May 25 15:31:47.365560 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.365860 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.366135 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.367336 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.367612 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.367898 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.404228 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.404510 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.404783 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.418247 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.418535 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.418805 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.448664 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.448948 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.449218 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.485865 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.486151 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.486420 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.719123 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.719720 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.719720 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.719927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.720628 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.844705 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.845033 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.845321 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.845600 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.845874 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.846246 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.846511 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.846772 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.847516 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.847803 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.848094 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.848361 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.848627 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.848888 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.849156 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.849429 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.850776 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.851075 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.851352 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.851652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.852052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.852322 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.852584 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.852877 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.853136 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.853392 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.853784 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.854030 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.854275 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.854520 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.854761 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.855004 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:47.855379 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 25 15:31:47.858520 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 25 15:31:47.862488 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 25 15:31:47.866219 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(350, 399)])]) May 25 15:31:47.867877 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 25 15:31:47.868403 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 25 15:31:47.868743 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 25 15:31:47.869132 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 25 15:31:47.872117 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 25 15:31:47.872374 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 25 15:31:47.872729 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 25 15:31:47.900751 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 25 15:31:47.901206 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.901505 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=98355) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 25 15:31:47.901869 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.903239 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=98355) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 25 15:31:47.903524 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 25 15:31:47.903778 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 25 15:31:47.907014 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.907301 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:47.976195 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 25 15:31:47.976366 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 25 15:31:47.976612 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 25 15:31:47.976990 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 25 15:31:48.007089 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_db.sqlalchemy.engines [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:31:48.346531 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing driver for type 'gre' May 25 15:31:48.347054 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] gre ID ranges: [(1, 1000)] May 25 15:31:48.395876 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing driver for type 'local' May 25 15:31:48.396222 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing driver for type 'vlan' May 25 15:31:48.407525 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] VlanTypeDriver initialization complete May 25 15:31:48.407877 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing driver for type 'vxlan' May 25 15:31:48.408399 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] vxlan ID ranges: [(1, 1000)] May 25 15:31:48.456666 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing extension driver 'port_security' May 25 15:31:48.457028 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.extensions.port_security [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] PortSecurityExtensionDriver initialization complete May 25 15:31:48.457369 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing mechanism driver 'openvswitch' May 25 15:31:48.457695 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing mechanism driver 'hyperv' May 25 15:31:48.464166 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.plugins.ml2.plugin [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=98355) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:31:48.464937 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.465316 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.465681 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.466072 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.466429 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.466778 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.467164 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.467519 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.467889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.468275 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.468630 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.468985 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.469357 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.469703 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.470046 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.470425 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > address_group after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.470771 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > address_group after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.471197 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > address_group after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.471540 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] ML2 OVO RPC backend initialized. {{(pid=98355) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}} May 25 15:31:48.472278 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.472634 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.473052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.473404 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > networks before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.473753 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.474097 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > ports before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.474443 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.474782 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnets before_response 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.475129 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.475475 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.475810 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.476183 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.476526 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.476863 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.477206 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.477550 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.477892 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > subnet after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.478473 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.plugin [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Modular L2 Plugin initialization complete May 25 15:31:48.478805 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading services supported by the core plugin {{(pid=98355) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 25 15:31:48.479139 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.plugins.ml2.managers [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Got port-security extension from driver 'port_security' May 25 15:31:48.479609 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.extensions.vlantransparent [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Disabled vlantransparent extension. May 25 15:31:48.480130 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=98355) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 25 15:31:48.480455 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: router May 25 15:31:48.518961 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.519351 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_create 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.519729 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router before_create 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.520128 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.520505 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.520864 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_delete 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.521226 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > floatingip after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.521593 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_create 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.521944 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.522297 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.522648 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.523013 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.523425 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.523797 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.524169 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.524511 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: subnet after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.524851 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.525205 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > port precommit_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.525559 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_create 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.525904 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.526256 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.526618 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router after_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.526963 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_delete 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.527315 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_create 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.527678 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router_interface after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.528056 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_update 55549900 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.528434 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > network after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.529294 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Tracking information for resource: router configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:48.529630 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Tracking information for resource: floatingip configured {{(pid=98355) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 15:31:48.534541 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.db.l3_agentschedulers_db [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 25 15:31:48.535124 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.535487 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.535840 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.536236 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: port after_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.537024 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router before_create 55550100 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.537393 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_delete 55550100 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.537758 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_create 55550100 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.538118 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > router precommit_update 55550100 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.542740 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.provider_configuration [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service providers = [] {{(pid=98355) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 25 15:31:48.543110 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.db.servicetype_db [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=98355) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 25 15:31:48.546058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.service_base [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=98355) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:31:48.546418 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.service_base [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=98355) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:31:48.546764 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.service_base [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=98355) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:31:48.547650 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.services.service_base [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=98355) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 15:31:48.548068 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.services.service_base [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Default provider is not specified for service type L3_ROUTER_NAT May 25 15:31:48.548607 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.548931 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 25 15:31:48.559954 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded METERING plugin. Description: METERING {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.560299 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: auto_allocate May 25 15:31:48.566483 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: network precommit_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.566852 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: network precommit_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.567370 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.567693 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: tag May 25 15:31:48.574440 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.574777 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: timestamp May 25 15:31:48.578547 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.578881 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: network_ip_availability May 25 15:31:48.584635 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.585007 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.585366 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.586085 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.586407 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: flavors May 25 15:31:48.591298 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.591639 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading Plugin: revisions May 25 15:31:48.595886 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=98355) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 15:31:48.596892 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.623s {{(pid=98355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:31:48.597590 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=98355) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} May 25 15:31:48.597929 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Initializing extension manager. May 25 15:31:48.598435 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: __init__.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.598781 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: __pycache__ {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.599118 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.599452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: address_group.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.600240 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.600799 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: address-group May 25 15:31:48.601123 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: address_scope.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.601831 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.602340 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: address-scope May 25 15:31:48.602662 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: admin_state_down_before_update.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.603583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.604141 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: router-admin-state-down-before-update May 25 15:31:48.604469 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: agent.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.605172 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.605681 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: agent May 25 15:31:48.606004 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: agent_resources_synced.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.606907 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.607419 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: agent-resources-synced May 25 15:31:48.607741 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: allowedaddresspairs.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.609536 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.610056 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: allowed-address-pairs May 25 15:31:48.610385 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: auto_allocated_topology.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.611457 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.612041 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: auto-allocated-topology May 25 15:31:48.612377 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: availability_zone.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.613071 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.613582 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: availability_zone May 25 15:31:48.613907 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: availability_zone_filter.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.614817 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.615334 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: availability_zone_filter May 25 15:31:48.615660 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: data_plane_status.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.616587 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.617095 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension data-plane-status not supported by any of loaded plugins May 25 15:31:48.617418 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: default_subnetpools.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.618325 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.618842 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: default-subnetpools May 25 15:31:48.619167 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: dhcpagentscheduler.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.620006 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.620522 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: dhcp_agent_scheduler May 25 15:31:48.620848 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: dns.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.621753 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.622258 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension dns-integration not supported by any of loaded plugins May 25 15:31:48.622581 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: dns_domain_ports.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.623494 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.624035 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension dns-domain-ports not supported by any of loaded plugins May 25 15:31:48.624363 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: dvr.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.625034 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.625540 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: dvr May 25 15:31:48.625863 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: empty_string_filtering.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.627033 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.627646 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: empty-string-filtering May 25 15:31:48.628010 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.628915 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.629421 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 25 15:31:48.629746 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.630647 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.631151 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 25 15:31:48.631477 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: external_net.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.632403 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.632915 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: external-net May 25 15:31:48.633241 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: extra_dhcp_opt.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.634139 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.634651 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: extra_dhcp_opt May 25 15:31:48.634980 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: extraroute.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.635918 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.636432 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: extraroute May 25 15:31:48.636756 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: extraroute_atomic.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.637772 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.638288 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: extraroute-atomic May 25 15:31:48.638612 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: filter_validation.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.639275 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.639781 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: filter-validation May 25 15:31:48.640135 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: fip_pf_description.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.641211 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.641724 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 25 15:31:48.642050 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: fip_port_details.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.643493 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.644048 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: fip-port-details May 25 15:31:48.644373 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: flavors.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.645593 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.646110 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: flavors May 25 15:31:48.646438 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.648112 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.648633 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 25 15:31:48.648963 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: floatingip_pools.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.649657 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.650166 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: floatingip-pools May 25 15:31:48.650492 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: ip_allocation.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.651412 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.651955 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension ip_allocation not supported by any of loaded plugins May 25 15:31:48.652283 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: ip_substring_port_filtering.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.653201 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.653711 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: ip-substring-filtering May 25 15:31:48.654038 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l2_adjacency.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.654954 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.655470 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension l2_adjacency not supported by any of loaded plugins May 25 15:31:48.655797 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.656944 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.657465 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: router May 25 15:31:48.657795 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3_conntrack_helper.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.660596 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.661125 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 25 15:31:48.661460 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3_ext_gw_mode.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.662391 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.662915 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: ext-gw-mode May 25 15:31:48.663246 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3_ext_ha_mode.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.664193 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.664711 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: l3-ha May 25 15:31:48.665041 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3_flavors.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.665957 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.666470 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: l3-flavors May 25 15:31:48.666799 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.667725 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.668269 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: l3-port-ip-change-not-allowed May 25 15:31:48.668597 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: l3agentscheduler.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.669617 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.670131 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: l3_agent_scheduler May 25 15:31:48.670462 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: logging.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.671980 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.672510 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension logging not supported by any of loaded plugins May 25 15:31:48.672845 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: metering.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.673583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.674180 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: metering May 25 15:31:48.674513 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.675604 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.676159 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: metering_source_and_destination_fields May 25 15:31:48.676491 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: multiprovidernet.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.677544 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.678061 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: multi-provider May 25 15:31:48.678391 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: netmtu.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.679309 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.679823 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: net-mtu May 25 15:31:48.680183 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: netmtu_writable.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.681101 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.681611 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: net-mtu-writable May 25 15:31:48.681941 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: network_availability_zone.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.682607 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.683117 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: network_availability_zone May 25 15:31:48.683441 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: network_ip_availability.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.684549 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.685069 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: network-ip-availability May 25 15:31:48.685408 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: network_segment_range.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.686166 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.686673 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension network-segment-range not supported by any of loaded plugins May 25 15:31:48.686999 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: pagination.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.687996 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.688332 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: pagination May 25 15:31:48.688655 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: port_device_profile.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.689556 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.690093 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: port-device-profile May 25 15:31:48.690419 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: port_mac_address_regenerate.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.691341 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.691851 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: port-mac-address-regenerate May 25 15:31:48.692198 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: port_numa_affinity_policy.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.693106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.693616 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: port-numa-affinity-policy May 25 15:31:48.693939 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: port_resource_request.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.694839 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.695344 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension port-resource-request not supported by any of loaded plugins May 25 15:31:48.695671 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: portbindings.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.696622 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.697134 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: binding May 25 15:31:48.697459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: portbindings_extended.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.698729 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.699246 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: binding-extended May 25 15:31:48.699575 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: portsecurity.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.700519 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.701030 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: port-security May 25 15:31:48.701354 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: project_id.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.702322 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.702651 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: project-id May 25 15:31:48.702973 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: providernet.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.703935 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.704453 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: provider May 25 15:31:48.704776 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.708811 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.709340 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos not supported by any of loaded plugins May 25 15:31:48.709675 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_bw_limit_direction.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.710917 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.711434 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 25 15:31:48.711769 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.712719 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.713238 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 25 15:31:48.713571 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_default.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.714474 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.714991 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-default not supported by any of loaded plugins May 25 15:31:48.715321 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_fip.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.716011 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.716517 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-fip not supported by any of loaded plugins May 25 15:31:48.716844 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_gateway_ip.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.717759 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.718271 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-gateway-ip not supported by any of loaded plugins May 25 15:31:48.718597 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_port_network_policy.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.719504 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.720054 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-port-network-policy not supported by any of loaded plugins May 25 15:31:48.720355 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_rule_type_details.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.721803 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.722316 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-rule-type-details not supported by any of loaded plugins May 25 15:31:48.722642 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: qos_rules_alias.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.723688 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.724242 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension qos-rules-alias not supported by any of loaded plugins May 25 15:31:48.724569 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: quotasv2.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.725589 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.725924 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: quotas May 25 15:31:48.726249 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: quotasv2_detail.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.727876 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.728235 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: quota_details May 25 15:31:48.728563 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: rbac.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.729598 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.730124 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: rbac-policies May 25 15:31:48.730454 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: rbac_address_group.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.731373 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.731988 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: rbac-address-group May 25 15:31:48.732312 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: rbac_address_scope.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.733231 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.733746 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: rbac-address-scope May 25 15:31:48.734071 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: rbac_security_groups.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.734976 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.735489 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: rbac-security-groups May 25 15:31:48.735817 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: rbac_subnetpool.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.736831 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.737348 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: rbac-subnetpool May 25 15:31:48.737674 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: revisionifmatch.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.738703 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.739217 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: revision-if-match May 25 15:31:48.739543 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: revisions.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.740692 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.741202 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: standard-attr-revisions May 25 15:31:48.741531 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: router_availability_zone.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.742199 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.742716 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: router_availability_zone May 25 15:31:48.743041 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: routerservicetype.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.744077 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.744599 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension router-service-type not supported by any of loaded plugins May 25 15:31:48.744926 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.745843 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.746361 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: security-groups-normalized-cidr May 25 15:31:48.746689 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: security_groups_port_filtering.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.747601 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.748139 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: port-security-groups-filtering May 25 15:31:48.748466 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: security_groups_remote_address_group.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.749381 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.749894 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: security-groups-remote-address-group May 25 15:31:48.750238 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: securitygroup.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.760675 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.761209 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: security-group May 25 15:31:48.761544 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: segment.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.762340 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.762870 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension segment not supported by any of loaded plugins May 25 15:31:48.763187 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.764150 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.764667 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 25 15:31:48.764997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: servicetype.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.766094 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.766621 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: service-type May 25 15:31:48.766948 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: sorting.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.768589 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.768936 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: sorting May 25 15:31:48.769262 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: standard_attr_segment.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.770173 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.770695 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension standard-attr-segment not supported by any of loaded plugins May 25 15:31:48.771022 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: standardattrdescription.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.771666 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.772325 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: standard-attr-description May 25 15:31:48.772652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: stateful_security_group.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.773566 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.774081 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: stateful-security-group May 25 15:31:48.774410 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: stdattrs_common.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.774987 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 25 15:31:48.775313 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.776332 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.776858 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 25 15:31:48.777183 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnet_onboard.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.778253 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.778779 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: subnet_onboard May 25 15:31:48.779106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnet_segmentid_writable.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.780064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.780583 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 25 15:31:48.780909 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnet_service_types.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.781830 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.782349 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: subnet-service-types May 25 15:31:48.782674 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnetallocation.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.783807 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.784360 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: subnet_allocation May 25 15:31:48.784688 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.785352 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.785864 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: subnetpool-prefix-ops May 25 15:31:48.786186 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.787125 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.787635 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 25 15:31:48.787995 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: tagging.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.789061 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.789585 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: standard-attr-tag May 25 15:31:48.789913 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: timestamp.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.791112 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.791632 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loaded extension: standard-attr-timestamp May 25 15:31:48.791998 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: trunk.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.793035 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.793554 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension trunk not supported by any of loaded plugins May 25 15:31:48.793885 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: trunk_details.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.794798 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.795315 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension trunk-details not supported by any of loaded plugins May 25 15:31:48.795643 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: uplink_status_propagation.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.796677 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.797192 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension uplink-status-propagation not supported by any of loaded plugins May 25 15:31:48.797518 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Loading extension file: vlantransparent.py {{(pid=98355) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 15:31:48.798185 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=98355) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 15:31:48.798693 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extension vlan-transparent not supported by any of loaded plugins May 25 15:31:48.801273 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:network May 25 15:31:48.802016 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnet May 25 15:31:48.803875 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:31:48.804525 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:port May 25 15:31:48.805813 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.806253 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service FLAVORS assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.806891 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.807336 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.807673 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:router May 25 15:31:48.808374 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:floatingip May 25 15:31:48.809077 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service METERING assigned prefix: /metering {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.810522 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.810901 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.811249 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=98355) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:31:48.812431 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of CountableResource for resource:rbac_policy May 25 15:31:48.812886 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:security_group May 25 15:31:48.813568 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:security_group_rule May 25 15:31:48.814312 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service CORE assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.814646 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:31:48.815502 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] subnetpool is already registered May 25 15:31:48.816143 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service CORE assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.816476 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:31:48.816816 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] subnetpool is already registered May 25 15:31:48.819454 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.819916 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service FLAVORS assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.820523 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.820948 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.821281 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:router May 25 15:31:48.821613 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] router is already registered May 25 15:31:48.822214 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:floatingip May 25 15:31:48.822543 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] floatingip is already registered May 25 15:31:48.823174 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service METERING assigned prefix: /metering {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.823888 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of CountableResource for resource:rbac_policy May 25 15:31:48.824220 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] rbac_policy is already registered May 25 15:31:48.824768 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:security_group May 25 15:31:48.825099 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] security_group is already registered May 25 15:31:48.825701 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:security_group_rule May 25 15:31:48.826043 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] security_group_rule is already registered May 25 15:31:48.826728 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service CORE assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.827066 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:31:48.827395 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] subnetpool is already registered May 25 15:31:48.828038 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.v2.resource_helper [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Service CORE assigned prefix: {{(pid=98355) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 15:31:48.828366 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Creating instance of TrackedResource for resource:subnetpool May 25 15:31:48.828690 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING neutron.quota.resource_registry [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] subnetpool is already registered May 25 15:31:48.829334 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: extensions {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.831503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: address-groups {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.833187 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: address-scopes {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.834409 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: agents {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.835577 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: auto-allocated-topology {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.836897 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: availability_zones {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.838230 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: dhcp-networks {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.839669 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: dhcp-agents {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.841165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: routers {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.842995 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: flavors {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.844204 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: service_profiles {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.845426 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: next_providers {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.847745 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: service_profiles {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.849682 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: floatingip-pools {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.851302 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: routers {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.854249 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: floatingips {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.855467 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: l3-routers {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.856923 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: l3-agents {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.858349 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: metering-labels {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.859718 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: metering-label-rules {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.861054 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: network-ip-availabilities {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.862998 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: bindings {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.864729 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: quotas {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.866567 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: quotas {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.868045 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: rbac-policies {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.869359 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: security-groups {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.870598 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: security-group-rules {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.871843 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: service-providers {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.873104 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: subnetpools {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.875523 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: subnetpools {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.877333 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.879079 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.991155 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.993044 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.994843 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.996851 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:48.998570 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:49.000534 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:49.002647 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:49.004559 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron.api.extensions [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Extended resource: tags {{(pid=98355) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 15:31:49.010558 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING keystonemiddleware.auth_token [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 15:31:49.015307 dv-cinder-791239-3-iscsi neutron-server[98355]: WARNING keystonemiddleware.auth_token [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 15:31:49.023669 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Acquired lock "singleton_lock" {{(pid=98355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 25 15:31:49.024183 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_concurrency.lockutils [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Releasing lock "singleton_lock" {{(pid=98355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 25 15:31:49.024812 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Starting 2 workers May 25 15:31:49.029557 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Started child 98462 {{(pid=98355) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:31:49.034471 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Started child 98463 {{(pid=98355) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:31:49.035148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.036051 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO neutron.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Neutron service started, listening on 0.0.0.0:9696 May 25 15:31:49.036695 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Notify callbacks [] for process, before_spawn {{(pid=98355) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.036797 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [-] (98462) wsgi starting up on http://0.0.0.0:9696 May 25 15:31:49.038864 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.039321 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Starting 1 workers May 25 15:31:49.040281 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [-] (98463) wsgi starting up on http://0.0.0.0:9696 May 25 15:31:49.044272 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Started child 98464 {{(pid=98355) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:31:49.044799 dv-cinder-791239-3-iscsi neutron-server[98355]: INFO oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Starting 1 workers May 25 15:31:49.047829 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] calling RpcWorker wait() {{(pid=98464) _wait /opt/stack/neutron/neutron/service.py:128}} May 25 15:31:49.048362 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] returning from RpcWorker wait() {{(pid=98464) _wait /opt/stack/neutron/neutron/service.py:135}} May 25 15:31:49.049283 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Started child 98465 {{(pid=98355) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 15:31:49.050129 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.050545 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG neutron_lib.callbacks.manager [None req-e1e5f284-1917-4cd3-b30c-a079d47a726f None None] Notify callbacks [] for process, after_spawn {{(pid=98355) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.050652 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:31:49.052589 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98355) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 15:31:49.052805 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:31:49.052993 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:31:49.053215 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:31:49.053565 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:31:49.053732 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:31:49.054232 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.054520 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.054799 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.055071 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.055379 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.055571 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:31:49.056077 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.056247 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.056495 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.056769 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.056901 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:31:49.057031 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.057206 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.057378 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.057634 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.057873 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.058204 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.058479 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.058726 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.059009 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.059186 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.059439 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.059724 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.060019 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.060272 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] debug = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.060455 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.060939 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.061174 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.061427 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.061687 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.061954 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.062203 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.062483 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.062730 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.062966 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.063206 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.063471 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.063722 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.063960 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.064185 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.064439 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.064672 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.065204 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] host = dv-cinder-791239-3-iscsi {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.065486 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.065740 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.065994 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.066245 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.066520 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.066741 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.067086 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.067255 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.067510 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.067761 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.068027 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.068331 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.068550 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.068791 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.068958 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_options = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.069180 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.069454 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.069725 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.069916 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.070089 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.070271 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.070598 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.070727 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.070963 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.071201 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.071417 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.071648 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.071952 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.072123 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.072381 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.072614 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.072852 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.073082 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.073339 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.073568 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.073800 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.074027 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.074260 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.074491 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.074853 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.075012 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.075208 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.075399 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.075611 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.075877 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.076787 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.076787 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.076787 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.077041 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.077217 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.077395 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.077621 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.077880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.078117 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.078378 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.078635 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.078849 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.079103 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.079326 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.079544 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.079792 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_json = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.080027 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.080237 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.080524 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.080739 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.080973 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.081551 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.081551 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.084058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.088458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089106 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.36/identity {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.089652 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090174 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090174 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090326 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090492 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090737 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.090978 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.092265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.092265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.092265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.092265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.092265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.094456 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.095452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.096524 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.096524 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.096749 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.096939 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.099619 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.102774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104126 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.104663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.105198 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.105198 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.105344 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106125 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106125 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106125 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106342 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106489 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.106696 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.107123 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.107226 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.107495 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.107688 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.107973 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.108257 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.108505 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.108769 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.109016 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.109286 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.109496 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.109771 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.110062 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.110343 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.110614 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.110939 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.111086 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.111312 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.111555 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.112401 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.112638 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.112889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.113081 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.113354 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.113602 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.113817 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.114052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.114277 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.114579 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.114811 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.115035 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.115241 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.115509 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.115805 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.116127 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.116263 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.116525 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.116761 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.117284 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.117284 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.36/identity {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.117593 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.117740 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.117894 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.118094 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.118324 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.118529 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.118759 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.119055 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.119227 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.119468 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.119691 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.122997 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.123325 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.123325 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.123524 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.123774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.124085 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.124353 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.124592 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.124837 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.125079 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.125294 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.125533 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.125751 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.125965 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.126203 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.126429 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.126910 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.127170 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.127458 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.127761 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.128035 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.128271 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.128511 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.128731 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.128984 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.129227 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.129466 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.129690 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.129916 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.130133 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.130407 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.130649 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.130872 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.131089 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.131306 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.131551 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.131774 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.132036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.132332 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.132596 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.132839 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.133077 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.133308 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.133556 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.133771 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.133985 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.134203 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.134431 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.134681 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.134892 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.135101 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.135318 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.135528 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.135753 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.135986 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.136198 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.136438 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.136657 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.136878 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.137087 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.137298 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.137513 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.137723 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.138048 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.138304 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.138531 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.138844 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.139078 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.139314 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.139593 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.140043 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.140270 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.140675 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.141071 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.141294 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.141519 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.141781 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.142104 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.142421 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.142715 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.143490 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.143768 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.144087 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.144337 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.144557 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.144867 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.145221 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.145506 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.145786 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.146055 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.146341 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.146575 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.146795 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.147013 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.147252 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.147471 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.147731 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.148056 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.148329 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.148583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.148816 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=98355) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 15:31:49.151880 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.152503 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153052 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153452 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153666 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153742 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.153894 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154058 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154220 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154388 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154550 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] config_source = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154711 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.154871 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155032 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] debug = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155193 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155387 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155555 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155717 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.155896 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156061 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156220 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156380 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156544 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156707 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.156866 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157026 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157186 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157347 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157507 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157668 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157828 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.157989 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] host = dv-cinder-791239-3-iscsi {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.158151 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.158312 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.158488 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.159291 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.159459 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.159622 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.159780 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.159962 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160127 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160288 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160448 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160607 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160767 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_dir = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.160927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161086 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_options = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161246 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161405 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161696 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161799 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.161959 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162112 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162583 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162818 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.162894 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.163024 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.163187 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.163543 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.163905 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164071 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164235 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164400 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164563 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164728 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.164888 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165057 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165216 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165404 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165536 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165657 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165806 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.165966 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166125 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166286 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166446 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166627 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166835 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.166951 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167089 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167229 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167376 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167540 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167699 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.167873 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168040 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168200 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168359 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168521 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168682 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_journal = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.168842 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_json = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169003 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169164 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169323 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169499 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169645 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169806 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.169965 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.170131 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.171163 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.172712 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173423 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173863 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173863 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.173863 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174234 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.36/identity {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174234 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174421 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174497 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174648 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174818 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.174984 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.175176 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.175305 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.175470 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.175630 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.175969 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.176132 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.176300 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.176466 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.176632 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.176912 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177109 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177109 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.177750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.180661 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.182812 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.183636 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184274 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184672 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184672 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184808 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:31:49.184889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.184889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185100 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185216 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185381 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185547 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185711 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.185874 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186198 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186360 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186521 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186685 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.186847 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187019 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187160 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187323 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187484 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187645 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.187817 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188003 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188168 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188332 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188675 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.188839 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189002 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189327 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189491 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189654 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.189841 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190006 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190173 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190339 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190507 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190681 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.190844 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191007 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191169 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191358 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191516 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191679 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.191843 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192028 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192190 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192354 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192516 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192680 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.192843 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193007 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193171 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.36/identity {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193335 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193499 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193663 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193826 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.193990 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194154 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194318 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194481 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194645 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194806 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.194969 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195133 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195296 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195460 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195623 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195785 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.195972 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.196135 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.196301 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.196468 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.196703 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.196878 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197026 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197190 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197356 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197523 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197688 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.197855 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.199889 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.200500 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.200500 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.200500 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.200500 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.200500 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.201038 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.201353 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.201538 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.201703 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.202014 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.202173 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.202325 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.202575 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.202762 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.203014 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.203014 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.203463 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.203463 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.203463 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204036 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204282 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204347 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204528 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204667 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204834 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.204999 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.205165 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.205328 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206013 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206178 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206340 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206666 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.206839 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207001 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207175 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207326 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207479 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207908 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.207908 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208064 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208140 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208279 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208451 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208614 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208775 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.208938 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209101 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209271 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209435 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209597 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209767 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.209934 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.210122 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.211927 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212502 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212891 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212891 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.212891 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213100 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213177 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213307 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213470 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213633 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213797 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.213958 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214121 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214284 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214448 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214610 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214773 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.214936 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215098 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215262 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215425 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215587 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215750 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.215952 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.216153 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:31:49.216265 dv-cinder-791239-3-iscsi neutron-server[98355]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=98355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:31:49.243711 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37760) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:31:49.252349 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [-] 10.222.0.36 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0065048 May 25 15:31:59.975659 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae50bba3-38d0-424f-bccc-eb605f41b6f9 None None] get_active_networks_info from dv-cinder-791239-3-iscsi {{(pid=98464) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} May 25 15:32:00.050169 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ae50bba3-38d0-424f-bccc-eb605f41b6f9 None None] No non-hosted networks {{(pid=98464) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 25 15:32:00.071457 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.agentschedulers_db [None req-ae50bba3-38d0-424f-bccc-eb605f41b6f9 None None] DHCP Agent not found on host dv-cinder-791239-3-iscsi {{(pid=98464) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} May 25 15:32:00.229491 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-70eec9a7-3744-422c-96c2-d9e2388f474a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:02.584525 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:02.585181 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.585710 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.586591 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.587511 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.588410 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.588737 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.589071 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.589417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.590913 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.591250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.591601 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.591903 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:02.592301 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-791239-3-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:02.605984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-791239-3-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:02.634417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1eff7c94-bcd4-4e27-8615-eee71024eef6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:02.675733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-426e4797-70e6-46c7-a23b-97a4c48939b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:03.454163 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:05.152922 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:05.686258 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.db.l3_hamode_db [None req-b9d69757-31e4-47fe-abcd-cb43bb7cb28a None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 25 15:32:05.779729 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9d69757-31e4-47fe-abcd-cb43bb7cb28a None None] Routers set() bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:32:05.780134 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9d69757-31e4-47fe-abcd-cb43bb7cb28a None None] Router IDs set() for agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} May 25 15:32:06.755019 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37852) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:07.335792 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING oslo_policy.policy [None req-b392645d-c532-4cd1-b068-e1d922c0067b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:32:07.336466 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING oslo_policy.policy [None req-b392645d-c532-4cd1-b068-e1d922c0067b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:32:07.555331 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-b392645d-c532-4cd1-b068-e1d922c0067b admin admin] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:32:07.556414 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b392645d-c532-4cd1-b068-e1d922c0067b admin admin] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8004785 May 25 15:32:09.889624 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37866) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:10.248729 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'default_prefixlen': 26, 'is_default': True, 'shared': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:10.348409 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.policy [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98463) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 15:32:10.394365 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING oslo_policy.policy [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:32:10.394735 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING oslo_policy.policy [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:32:10.403192 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.quota [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Loaded quota_driver: . May 25 15:32:10.418941 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:10.477566 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733212261', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733221830', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733165841', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733162701', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733182784', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8752733188681', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3883161', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3921691', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-666368', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-575725'] for rbac-policy, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:10.537943 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:10.539144 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-69f2a319-1c60-41e6-9fb2-b0c19e9047b1 admin admin] 10.222.0.36 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6485176 May 25 15:32:13.124241 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37880) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:13.473924 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Request body: {'network': {'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'name': 'private'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:13.478580 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:13.483018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Usage tracker for resource:network and tenant:d0b16551978f4a0aaaac3775f567eb8f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:13.488002 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:13.494020 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:13.504347 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Made reservation on behalf of d0b16551978f4a0aaaac3775f567eb8f for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:32:13.507080 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.524296 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.539160 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:13.542817 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Usage tracker for resource:security_group_rule and tenant:d0b16551978f4a0aaaac3775f567eb8f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:13.547636 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:13.553818 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:13.648803 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.652488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.657563 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:13.675834 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 351} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:32:13.702260 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8752734249445', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.702868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Unsubscribe: segment precommit_create {{(pid=98463) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 15:32:13.703338 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Added segment c102be3f-414e-4212-bc8e-b5a916d188b1 of type vlan for network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf May 25 15:32:13.750306 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2244daae-57e2-4f1a-a414-7cf1db935389,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:13.772013 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.772369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.772701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.773023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.773342 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.773679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.773996 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.774305 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.774634 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.774945 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.775253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.775558 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Tracked resource versions report: May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: pushed versions: May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: { 'AddressGroup': {'1.2'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'ConntrackHelper': {'1.0'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Log': {'1.0'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Network': {'1.1'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Port': {'1.7'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'PortForwarding': {'1.2'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'QosPolicy': {'1.8'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroup': {'1.4'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroupRule': {'1.2'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SubPort': {'1.0'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Subnet': {'1.1'}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Trunk': {'1.1'}} May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: consumer versions: May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'ConntrackHelper': '1.0', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Log': '1.0', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Network': '1.1', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Port': '1.7', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'PortForwarding': '1.2', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'QosPolicy': '1.8', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroup': '1.4', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroupRule': '1.2', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SubPort': '1.0', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Subnet': '1.1', May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Trunk': '1.1'}} May 25 15:32:13.776636 dv-cinder-791239-3-iscsi neutron-server[98463]: {{(pid=98463) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:32:13.822884 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.828214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:13.864667 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.866311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:13.866970 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:13.871364 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:13.974433 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8490770 May 25 15:32:13.975054 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Pushing event updated for resources: {'Network': ['ID=c3ebb6d1-c57b-4639-840a-cc0a3a4352bf,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:13.978131 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:13.987272 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:32:16.628423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37896) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:17.077149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bea10ab4-3791-4373-96c4-857aa9fa6a65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:17.078414 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bea10ab4-3791-4373-96c4-857aa9fa6a65 admin admin] 10.222.0.36 "GET /v2.0/networks/c3ebb6d1-c57b-4639-840a-cc0a3a4352bf HTTP/1.1" status: 200 len: 825 time: 0.4490552 May 25 15:32:17.104366 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4bc2ffde-e6a3-4efb-88f6-caa3d9ee482a admin admin] 10.222.0.36 "GET /v2.0/subnetpools/0158facc-912d-41a2-a308-7cef7b4d4d44 HTTP/1.1" status: 200 len: 734 time: 0.0206795 May 25 15:32:17.112886 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:17.117395 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:17.121268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Usage tracker for resource:subnet and tenant:d0b16551978f4a0aaaac3775f567eb8f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:17.124198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:17.130615 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:17.140114 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Made reservation on behalf of d0b16551978f4a0aaaac3775f567eb8f for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:32:17.142371 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:17.626277 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:17.631508 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:17.713790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Checking segment: {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:32:17.714291 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Network hostable DHCP agents. Network: c3ebb6d1-c57b-4639-840a-cc0a3a4352bf, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:32:17.719881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Pushing event updated for resources: {'Subnet': ['ID=50df14d4-f3c9-4b59-bc45-104d1a09b685,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:17.729349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:17.739947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:32:17.749214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, c3ebb6d1-c57b-4639-840a-cc0a3a4352bf) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:17.754002 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:17.754577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:17.759196 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-826abd29-614b-4941-9a78-6876c9307b3b None None] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:32:17.774441 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.6652348 May 25 15:32:18.067654 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:32:18.068936 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.251255 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Allocated IP 172.20.0.2 (c3ebb6d1-c57b-4639-840a-cc0a3a4352bf/50df14d4-f3c9-4b59-bc45-104d1a09b685/076e7857-a6ab-4288-96c8-c45fcaf247da) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:32:18.479953 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.498869 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Transition to ACTIVE for port object 076e7857-a6ab-4288-96c8-c45fcaf247da will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:32:18.519284 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Transition to ACTIVE for port object 076e7857-a6ab-4288-96c8-c45fcaf247da will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:32:18.525952 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.532710 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:18.595647 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:32:18.598210 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:18.601938 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:32:18.612471 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Pushing event updated for resources: {'Port': ['ID=076e7857-a6ab-4288-96c8-c45fcaf247da,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:18.655169 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.655509 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.655833 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.656180 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.656497 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.656813 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.657125 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.657435 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.657762 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.658073 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.658380 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.658685 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Tracked resource versions report: May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: pushed versions: May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: { 'AddressGroup': {'1.2'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'ConntrackHelper': {'1.0'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Log': {'1.0'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Network': {'1.1'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Port': {'1.7'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'PortForwarding': {'1.2'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'QosPolicy': {'1.8'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroup': {'1.4'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroupRule': {'1.2'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SubPort': {'1.0'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Subnet': {'1.1'}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Trunk': {'1.1'}} May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: consumer versions: May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'ConntrackHelper': '1.0', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Log': '1.0', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Network': '1.1', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Port': '1.7', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'PortForwarding': '1.2', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'QosPolicy': '1.8', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroup': '1.4', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroupRule': '1.2', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SubPort': '1.0', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Subnet': '1.1', May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Trunk': '1.1'}} May 25 15:32:18.659777 dv-cinder-791239-3-iscsi neutron-server[98464]: {{(pid=98464) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:32:18.693143 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:18.712105 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Attempting to bind port 076e7857-a6ab-4288-96c8-c45fcaf247da on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:32:18.712490 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Attempting to bind port 076e7857-a6ab-4288-96c8-c45fcaf247da by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:32:18.712904 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Attempting to bind port 076e7857-a6ab-4288-96c8-c45fcaf247da on network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:32:18.718018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 32, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:32:18.718411 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Checking segment: {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:32:18.718863 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.719272 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Bound using segment: {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:32:18.719797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Bound port: 076e7857-a6ab-4288-96c8-c45fcaf247da, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:32:18.720202 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.807478 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] For port 076e7857-a6ab-4288-96c8-c45fcaf247da, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:32:18.811507 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] For port 076e7857-a6ab-4288-96c8-c45fcaf247da, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=076e7857-a6ab-4288-96c8-c45fcaf247da,segment=NetworkSegment(c102be3f-414e-4212-bc8e-b5a916d188b1),segment_id=c102be3f-414e-4212-bc8e-b5a916d188b1)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:32:18.816166 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:18.820048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:18.903156 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Pushing event updated for resources: {'Port': ['ID=076e7857-a6ab-4288-96c8-c45fcaf247da,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:18.906579 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:20.158049 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37906) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:20.528369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-3b45c8ff-d526-4fd3-8f76-cf3dfa76c678 admin admin] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:32:20.529352 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3b45c8ff-d526-4fd3-8f76-cf3dfa76c678 admin admin] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3703458 May 25 15:32:22.892215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37916) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:23.268547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-90dac303-2a32-44a7-9582-2030dc2b35da admin admin] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:32:23.270032 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-90dac303-2a32-44a7-9582-2030dc2b35da admin admin] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3763647 May 25 15:32:24.391367 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 076e7857-a6ab-4288-96c8-c45fcaf247da up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:24.422035 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d801f5b8-a023-4cb4-aa4f-a9d845dc9d79 None None] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:32:24.549677 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-05915ee8-db9a-477e-a508-01f75790e7e4 None None] Provisioning for port 076e7857-a6ab-4288-96c8-c45fcaf247da completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:32:24.588070 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 076e7857-a6ab-4288-96c8-c45fcaf247da completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:32:24.596641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 076e7857-a6ab-4288-96c8-c45fcaf247da triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:24.597076 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:24.831577 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:24.870783 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 076e7857-a6ab-4288-96c8-c45fcaf247da, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=076e7857-a6ab-4288-96c8-c45fcaf247da,segment=NetworkSegment(c102be3f-414e-4212-bc8e-b5a916d188b1),segment_id=c102be3f-414e-4212-bc8e-b5a916d188b1)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:32:24.875044 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:24.877750 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:24.945249 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=076e7857-a6ab-4288-96c8-c45fcaf247da,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:24.949483 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:25.090488 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-858e2c56-99d8-49e9-998c-625096edabe0 None None] Provisioning complete for port 076e7857-a6ab-4288-96c8-c45fcaf247da triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:25.090786 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-858e2c56-99d8-49e9-998c-625096edabe0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:25.912539 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37934) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:26.260375 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'name': 'router1'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:26.265113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:26.269511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Usage tracker for resource:router and tenant:d0b16551978f4a0aaaac3775f567eb8f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:26.272798 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:26.278462 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:26.288647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.290240 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.317232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.356283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 076e7857-a6ab-4288-96c8-c45fcaf247da up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:26.422791 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 076e7857-a6ab-4288-96c8-c45fcaf247da triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:26.423037 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.428309 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.447091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:26.448293 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a9acedd6-9781-4032-a716-4de26c8ae369 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5347950 May 25 15:32:28.782981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37944) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:29.148606 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-e42f06e9-c093-4213-8fe5-c6074a6049b8 admin admin] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:32:29.149567 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e42f06e9-c093-4213-8fe5-c6074a6049b8 admin admin] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3656769 May 25 15:32:29.925525 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d388aede-4d8d-4d76-a7c3-9694f364a359 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:31.480919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37954) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:31.849117 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Request body: {'network': {'is_default': True, 'admin_state_up': True, 'router:external': True, 'provider:physical_network': 'physnet1', 'name': 'public', 'provider:network_type': 'flat'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:31.853927 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:31.857674 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Usage tracker for resource:network and tenant:e7c1839e767741ad9efeddce513f9b35 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:31.860437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:31.866499 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:31.876022 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Made reservation on behalf of e7c1839e767741ad9efeddce513f9b35 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:32:31.879056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:31.890521 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:31.903979 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:31.907523 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Usage tracker for resource:security_group_rule and tenant:e7c1839e767741ad9efeddce513f9b35 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:31.910148 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:31.916040 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:31.998053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.001660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.005806 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:32.018440 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Reserving flat network on physical network physnet1 {{(pid=98463) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 25 15:32:32.041683 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56453cc9-7ba4-4ff8-b5d9-907ed479b44d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:32.044568 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.044941 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Added segment 68db3f28-5dc9-4720-b834-2eec1a899865 of type flat for network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da May 25 15:32:32.046056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:32.076694 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.111984 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.113279 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:32.113848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.118349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:32.211540 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7295585 May 25 15:32:32.214038 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Pushing event updated for resources: {'Network': ['ID=5faa42c5-bc4c-4066-864c-fb4aa8b3c7da,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:32.216641 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:32.225433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:32:32.570520 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:32.617886 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1b714500-ce7f-4d13-adee-2908f378a4d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:33.369303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:34.561086 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37974) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:34.766088 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b2822bea-1520-4b9c-abb3-7f7224daa9bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:34.767377 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b2822bea-1520-4b9c-abb3-7f7224daa9bd admin admin] 10.222.0.36 "GET /v2.0/subnets/50df14d4-f3c9-4b59-bc45-104d1a09b685 HTTP/1.1" status: 200 len: 849 time: 0.2054145 May 25 15:32:34.906689 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-31775cb0-24b8-4844-a6fc-a1107fa3567f admin admin] 10.222.0.36 "GET /v2.0/routers/7a67ce30-a848-4f3c-b059-3e558c626424 HTTP/1.1" status: 200 len: 704 time: 0.1333666 May 25 15:32:35.072701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:35.391001 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:35.619517 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Allocated IP 172.20.0.1 (c3ebb6d1-c57b-4639-840a-cc0a3a4352bf/50df14d4-f3c9-4b59-bc45-104d1a09b685/488b82b4-5923-427e-a35d-394fd794b754) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:32:35.775813 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:35.792412 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Transition to ACTIVE for port object 488b82b4-5923-427e-a35d-394fd794b754 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:32:35.845660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:35.850095 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:35.910483 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:32:35.912968 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:35.916148 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:32:35.916653 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.044543 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Pushing event updated for resources: {'Port': ['ID=488b82b4-5923-427e-a35d-394fd794b754,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:36.048666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:36.090685 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-fc4e7e07-4152-420a-a5c0-793c591e2290 None None] Provisioning for port 488b82b4-5923-427e-a35d-394fd794b754 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:32:36.095533 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-fc4e7e07-4152-420a-a5c0-793c591e2290 None None] Provisioning complete for port 488b82b4-5923-427e-a35d-394fd794b754 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:36.096061 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-fc4e7e07-4152-420a-a5c0-793c591e2290 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.152803 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-fc4e7e07-4152-420a-a5c0-793c591e2290 None None] Port 488b82b4-5923-427e-a35d-394fd794b754 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:32:36.180200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.405327 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.409799 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.410852 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.414807 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:36.542909 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Pushing event updated for resources: {'Port': ['ID=488b82b4-5923-427e-a35d-394fd794b754,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:36.546733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:36.601919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:32:36.602896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:36.774889 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-f8ac5978-7b0a-4319-9de4-0acec4d5a421 None None] Provisioning complete for port 488b82b4-5923-427e-a35d-394fd794b754 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:36.775264 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f8ac5978-7b0a-4319-9de4-0acec4d5a421 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:36.827845 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-f8ac5978-7b0a-4319-9de4-0acec4d5a421 None None] Port 488b82b4-5923-427e-a35d-394fd794b754 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:32:36.832730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Router 7a67ce30-a848-4f3c-b059-3e558c626424 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:32:36.983401 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:32:36.993241 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Sync routers for ids ['7a67ce30-a848-4f3c-b059-3e558c626424'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:32:36.993711 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] 10.222.0.36 "PUT /v2.0/routers/7a67ce30-a848-4f3c-b059-3e558c626424/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0817139 May 25 15:32:37.003681 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Routers {'7a67ce30-a848-4f3c-b059-3e558c626424'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:32:37.004628 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:32:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['7a67ce30-a848-4f3c-b059-3e558c626424'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:37.212311 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Set router 7a67ce30-a848-4f3c-b059-3e558c626424 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:32:37.579199 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:36Z', 'revision_number': 2, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port_host': None, '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:36Z', 'revision_number': 2, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:37.584594 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Checking router: 7a67ce30-a848-4f3c-b059-3e558c626424 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:32:37.584968 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Updating router 7a67ce30-a848-4f3c-b059-3e558c626424 port 488b82b4-5923-427e-a35d-394fd794b754 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:32:37.636082 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.008863 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.023486 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Transition to ACTIVE for port object 488b82b4-5923-427e-a35d-394fd794b754 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:32:38.030152 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.035615 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:38.161398 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Pushing event updated for resources: {'Port': ['ID=488b82b4-5923-427e-a35d-394fd794b754,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:38.203058 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.203399 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.203726 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.204082 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.204400 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.204715 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.205064 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.205378 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.205716 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.206027 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.206332 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.206635 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Tracked resource versions report: May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: pushed versions: May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: { 'AddressGroup': {'1.2'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'ConntrackHelper': {'1.0'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Log': {'1.0'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Network': {'1.1'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Port': {'1.7'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'PortForwarding': {'1.2'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'QosPolicy': {'1.8'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroup': {'1.4'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroupRule': {'1.2'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SubPort': {'1.0'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Subnet': {'1.1'}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Trunk': {'1.1'}} May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: consumer versions: May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'ConntrackHelper': '1.0', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Log': '1.0', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Network': '1.1', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Port': '1.7', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'PortForwarding': '1.2', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'QosPolicy': '1.8', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroup': '1.4', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroupRule': '1.2', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SubPort': '1.0', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Subnet': '1.1', May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Trunk': '1.1'}} May 25 15:32:38.207736 dv-cinder-791239-3-iscsi neutron-server[98465]: {{(pid=98465) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:32:38.240205 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:38.265952 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Attempting to bind port 488b82b4-5923-427e-a35d-394fd794b754 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:32:38.266346 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Attempting to bind port 488b82b4-5923-427e-a35d-394fd794b754 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:32:38.266770 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Attempting to bind port 488b82b4-5923-427e-a35d-394fd794b754 on network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:32:38.272041 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 32, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:32:38.272443 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Checking segment: {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:32:38.272908 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.273297 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Bound using segment: {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:32:38.273828 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Bound port: 488b82b4-5923-427e-a35d-394fd794b754, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c102be3f-414e-4212-bc8e-b5a916d188b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 351, 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:32:38.274193 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.361077 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] For port 488b82b4-5923-427e-a35d-394fd794b754, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:32:38.365741 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] For port 488b82b4-5923-427e-a35d-394fd794b754, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=488b82b4-5923-427e-a35d-394fd794b754,segment=NetworkSegment(c102be3f-414e-4212-bc8e-b5a916d188b1),segment_id=c102be3f-414e-4212-bc8e-b5a916d188b1)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:32:38.371043 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:38.374705 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:38.458800 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Pushing event updated for resources: {'Port': ['ID=488b82b4-5923-427e-a35d-394fd794b754,revision_number=4']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:38.462260 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:38.463854 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Routers {'7a67ce30-a848-4f3c-b059-3e558c626424'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:32:38.464484 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:32:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['7a67ce30-a848-4f3c-b059-3e558c626424'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:38.642993 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] Set router 7a67ce30-a848-4f3c-b059-3e558c626424 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:32:38.960293 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:36Z', 'revision_number': 2, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port_host': None, '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:38Z', 'revision_number': 4, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:38.964118 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ee4c56fa-2c52-4fc0-9db2-8e214fabe811 None None] The sync data for ids ['7a67ce30-a848-4f3c-b059-3e558c626424'] in dv-cinder-791239-3-iscsi is: [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:36Z', 'revision_number': 2, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port_host': None, '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:38Z', 'revision_number': 4, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:32:39.180890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 37996) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:39.327108 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d785a66-b412-4daf-9261-9e259ba9e3a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:39.327590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0d785a66-b412-4daf-9261-9e259ba9e3a1 admin admin] Synchronizing usage tracker for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:32:39.345083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0d785a66-b412-4daf-9261-9e259ba9e3a1 admin admin] Unset dirty status for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:32:39.346904 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0d785a66-b412-4daf-9261-9e259ba9e3a1 admin admin] 10.222.0.36 "GET /v2.0/networks/5faa42c5-bc4c-4066-864c-fb4aa8b3c7da HTTP/1.1" status: 200 len: 842 time: 0.1650822 May 25 15:32:39.356987 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Request body: {'subnet': {'ip_version': 4, 'gateway_ip': '172.27.0.1', 'enable_dhcp': False, 'cidr': '172.27.0.0/24', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'name': 'public-subnet'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:39.362121 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:32:39.365877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Usage tracker for resource:subnet and tenant:e7c1839e767741ad9efeddce513f9b35 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:32:39.368545 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:32:39.374719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:32:39.384890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Made reservation on behalf of e7c1839e767741ad9efeddce513f9b35 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:32:39.387505 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:39.799046 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.objects.ports [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=98463) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} May 25 15:32:39.799469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:39.803769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7e213ddb-bb28-479b-8910-d4b90ed99015 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:39.872639 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Pushing event updated for resources: {'Subnet': ['ID=ffbac48b-f0bf-4296-959e-36eeb4ffe30f,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:39.876733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:39.882082 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:32:39.882438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Network hostable DHCP agents. Network: 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:32:39.898735 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:32:39.908285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:39.915988 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:39.916576 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:39.917225 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b3db113-d173-4ba2-9570-37e67e37c06f None None] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:32:39.948683 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5842757 May 25 15:32:40.123489 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-51f9836c-4d4b-4d9f-a3be-4c26645f2fb3 None None] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:32:41.108792 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:32:42.190681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38010) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:42.383467 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 488b82b4-5923-427e-a35d-394fd794b754 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:42.397031 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-122fbe77-9874-438e-ad1c-ca7b0eadfd1e admin admin] 10.222.0.36 "GET /v2.0/routers/7a67ce30-a848-4f3c-b059-3e558c626424 HTTP/1.1" status: 200 len: 710 time: 0.2052042 May 25 15:32:42.454535 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 488b82b4-5923-427e-a35d-394fd794b754 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:32:42.459197 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 488b82b4-5923-427e-a35d-394fd794b754 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:42.459576 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:42.522378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58c74cbe-41db-452f-8f52-f915d39ddb51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:32:42.523744 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-58c74cbe-41db-452f-8f52-f915d39ddb51 admin admin] 10.222.0.36 "GET /v2.0/networks/5faa42c5-bc4c-4066-864c-fb4aa8b3c7da HTTP/1.1" status: 200 len: 886 time: 0.1242776 May 25 15:32:42.532360 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:32:42.576490 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:42.609762 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 488b82b4-5923-427e-a35d-394fd794b754, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=488b82b4-5923-427e-a35d-394fd794b754,segment=NetworkSegment(c102be3f-414e-4212-bc8e-b5a916d188b1),segment_id=c102be3f-414e-4212-bc8e-b5a916d188b1)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:32:42.614488 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:42.618025 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:42.691045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=488b82b4-5923-427e-a35d-394fd794b754,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:42.695345 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:43.022903 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:43.355777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:43.409713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:43.541627 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Allocated IP 172.27.0.169 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/3ddeaf34-76f5-4f4b-a590-ab46e3b138cb) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:32:43.680135 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:43.708581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:43.712912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:43.773629 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:32:43.776425 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:32:43.778934 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:32:43.904212 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Pushing event updated for resources: {'Port': ['ID=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:43.909438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:44.195940 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:44.368078 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 488b82b4-5923-427e-a35d-394fd794b754 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:44.433521 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 488b82b4-5923-427e-a35d-394fd794b754 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:44.433888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:44.524655 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:44.527912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-763044', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-763109', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-765809'] for router, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:44.699489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Router 7a67ce30-a848-4f3c-b059-3e558c626424 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:32:44.870249 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:32:44.878779 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:44.879649 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Sync routers for ids ['7a67ce30-a848-4f3c-b059-3e558c626424'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:32:44.880002 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] 10.222.0.36 "PUT /v2.0/routers/7a67ce30-a848-4f3c-b059-3e558c626424 HTTP/1.1" status: 200 len: 890 time: 2.3508470 May 25 15:32:44.889862 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Routers {'7a67ce30-a848-4f3c-b059-3e558c626424'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:32:44.890527 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:32:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['7a67ce30-a848-4f3c-b059-3e558c626424'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:45.078769 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Set router 7a67ce30-a848-4f3c-b059-3e558c626424 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:32:45.416213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169'}], 'enable_snat': True}, 'gw_port_id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:43Z', 'revision_number': 4, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port': {'id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:58:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:43Z', 'updated_at': '2021-05-25T15:32:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:42Z', 'revision_number': 5, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:45.420964 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Checking router: 7a67ce30-a848-4f3c-b059-3e558c626424 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:32:45.421321 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Updating router 7a67ce30-a848-4f3c-b059-3e558c626424 port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:32:45.472403 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.798443 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.811841 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Transition to ACTIVE for port object 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:32:45.820276 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.824253 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:45.903083 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Attempting to bind port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:32:45.903446 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Attempting to bind port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:32:45.903873 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Attempting to bind port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:32:45.905899 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Pushing event updated for resources: {'Port': ['ID=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:45.909772 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:45.912895 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 32, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:32:45.912895 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:32:45.913090 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.913380 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:32:45.913840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Bound port: 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:32:45.914207 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.982902 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] For port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:32:45.985851 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] For port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:32:45.990945 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:45.994821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:46.071852 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Routers {'7a67ce30-a848-4f3c-b059-3e558c626424'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:32:46.072475 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:32:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['7a67ce30-a848-4f3c-b059-3e558c626424'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:46.117755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Pushing event updated for resources: {'Port': ['ID=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:46.128115 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:46.253644 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] Set router 7a67ce30-a848-4f3c-b059-3e558c626424 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:32:46.601184 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169'}], 'enable_snat': True}, 'gw_port_id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:43Z', 'revision_number': 4, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port': {'id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:58:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:43Z', 'updated_at': '2021-05-25T15:32:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:42Z', 'revision_number': 5, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:32:46.605241 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2014f100-ec61-48d5-9df4-b14c03dd121b None None] The sync data for ids ['7a67ce30-a848-4f3c-b059-3e558c626424'] in dv-cinder-791239-3-iscsi is: [{'id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'name': 'router1', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169'}], 'enable_snat': True}, 'gw_port_id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:32:26Z', 'updated_at': '2021-05-25T15:32:43Z', 'revision_number': 4, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'gw_port': {'id': '3ddeaf34-76f5-4f4b-a590-ab46e3b138cb', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:db:58:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.169', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:43Z', 'updated_at': '2021-05-25T15:32:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '488b82b4-5923-427e-a35d-394fd794b754', 'name': '', 'network_id': 'c3ebb6d1-c57b-4639-840a-cc0a3a4352bf', 'tenant_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'mac_address': 'fa:16:3e:1b:16:a4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7a67ce30-a848-4f3c-b059-3e558c626424', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:32:35Z', 'updated_at': '2021-05-25T15:32:42Z', 'revision_number': 5, 'project_id': 'd0b16551978f4a0aaaac3775f567eb8f', 'subnets': [{'id': '50df14d4-f3c9-4b59-bc45-104d1a09b685', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0158facc-912d-41a2-a308-7cef7b4d4d44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:32:47.205367 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38020) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:32:47.319946 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-800e521a-c05e-466f-8d5e-279cc67f4929 admin admin] 10.222.0.36 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1134448 May 25 15:32:48.397750 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:48.473053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:32:48.477890 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:48.478266 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:48.597177 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:48.613659 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:32:48.617391 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:48.619537 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:32:48.683765 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=3ddeaf34-76f5-4f4b-a590-ab46e3b138cb,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:32:48.686676 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:32:50.378830 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:32:50.444699 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 3ddeaf34-76f5-4f4b-a590-ab46e3b138cb triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:32:50.445098 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:32:59.928469 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-c1ba3eff-da51-4976-8e34-8b67a5a6e08b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:02.579555 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:02.628093 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1e2432aa-2bc3-43e0-9cc2-2156086eb68f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:03.374540 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:05.097470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:18.108533 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:33:29.932369 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-57ef8078-2bd9-40ea-8abd-31964e5f7bd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:32.577220 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:32.624854 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf9baac5-d999-45de-8f95-07187ddbef75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:33.375523 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:35.091267 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:33:55.106482 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:33:59.938027 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-04383f03-c022-4aa8-9166-d9657f91cfc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:02.580209 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:02.627510 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-584bf7f5-f45a-48d9-b91d-5b4b6b4a72e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:03.380677 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:05.095007 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:21.675007 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38590) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:21.740941 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.pecan_wsgi.hooks.translation [None req-891e13ba-67fe-4282-bc89-945f33e0feb8 admin admin] GET failed (client error): The resource could not be found. May 25 15:34:21.742178 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-891e13ba-67fe-4282-bc89-945f33e0feb8 admin admin] 10.222.0.36 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0662453 May 25 15:34:21.874783 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1dd71212-a537-4bf0-a956-c7e242965999 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:21.877379 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1dd71212-a537-4bf0-a956-c7e242965999 admin admin] 10.222.0.36 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1314759 May 25 15:34:23.997846 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38600) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:24.106225 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3e1e6b14-1dae-428f-a799-5755d8901b0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:24.106700 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3e1e6b14-1dae-428f-a799-5755d8901b0a admin admin] Synchronizing usage tracker for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:subnet {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:34:24.122914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3e1e6b14-1dae-428f-a799-5755d8901b0a admin admin] Unset dirty status for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:subnet {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:34:24.124360 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3e1e6b14-1dae-428f-a799-5755d8901b0a admin admin] 10.222.0.36 "GET /v2.0/subnets/50df14d4-f3c9-4b59-bc45-104d1a09b685 HTTP/1.1" status: 200 len: 849 time: 0.1255786 May 25 15:34:24.134753 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:34:24.246251 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Notify callbacks [] for subnet, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:24.483789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8752734189469'] for subnet, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:24.488280 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-89a98553-3307-42fe-a43e-60b7ed5ebaff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:34:24.527123 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:24.528087 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:24.543904 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] 10.222.0.36 "PUT /v2.0/subnets/50df14d4-f3c9-4b59-bc45-104d1a09b685 HTTP/1.1" status: 200 len: 868 time: 0.3982167 May 25 15:34:24.544124 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20aabe65-9cd4-4ea2-8c2d-d419ea8171c5 None None] Network c3ebb6d1-c57b-4639-840a-cc0a3a4352bf requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:34:24.552219 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Pushing event updated for resources: {'Subnet': ['ID=50df14d4-f3c9-4b59-bc45-104d1a09b685,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:34:24.559981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.560364 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.560692 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.561021 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.561345 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.561684 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.562006 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.562333 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.562801 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.563484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.563812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.564138 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:34:24.567811 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:34:24.992384 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8927f16e-ce54-4bbc-abf1-cf9a81a59965 None None] Provisioning complete for port 488b82b4-5923-427e-a35d-394fd794b754 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:24.992757 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8927f16e-ce54-4bbc-abf1-cf9a81a59965 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:25.115302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8927f16e-ce54-4bbc-abf1-cf9a81a59965 None None] Provisioning complete for port 076e7857-a6ab-4288-96c8-c45fcaf247da triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:34:25.115564 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8927f16e-ce54-4bbc-abf1-cf9a81a59965 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:26.656102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38610) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:26.830059 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64c494ab-71c6-49b8-a25c-17a160410cc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:26.830530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64c494ab-71c6-49b8-a25c-17a160410cc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:26.832081 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-64c494ab-71c6-49b8-a25c-17a160410cc1 admin admin] 10.222.0.36 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1750267 May 25 15:34:28.933836 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 38620) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:29.072671 dv-cinder-791239-3-iscsi neutron-server[98462]: WARNING oslo_policy.policy [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:34:29.073295 dv-cinder-791239-3-iscsi neutron-server[98462]: WARNING oslo_policy.policy [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:34:29.547940 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.policy [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=98462) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 15:34:29.593696 dv-cinder-791239-3-iscsi neutron-server[98462]: WARNING oslo_policy.policy [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:34:29.594096 dv-cinder-791239-3-iscsi neutron-server[98462]: WARNING oslo_policy.policy [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 15:34:29.602508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:29.603003 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:29.605022 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c714d8a3-9d87-47a0-9ecf-e5e5929394e3 admin admin] 10.222.0.36 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.6692035 May 25 15:34:29.941053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-ad6b5b3a-2357-44a3-911a-7b02606c1c11 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:31.724447 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 38636) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:31.893054 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-687448b7-368b-4707-a51a-50f22f91dfae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:31.894394 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-687448b7-368b-4707-a51a-50f22f91dfae admin admin] 10.222.0.36 "GET /v2.0/networks/5faa42c5-bc4c-4066-864c-fb4aa8b3c7da HTTP/1.1" status: 200 len: 886 time: 0.1689272 May 25 15:34:32.105438 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:34:32.582655 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:32.630347 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6329bdfc-6c96-48a6-a50e-d431ec91ad82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:33.382939 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:34.010174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38646) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:34.180066 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6de73099-f252-4f95-a494-4d7586164bd4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:34.181310 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6de73099-f252-4f95-a494-4d7586164bd4 admin admin] 10.222.0.36 "GET /v2.0/networks/c3ebb6d1-c57b-4639-840a-cc0a3a4352bf HTTP/1.1" status: 200 len: 869 time: 0.1702151 May 25 15:34:35.097531 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:34:36.290111 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38656) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:36.394492 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d61c4fd9-fc59-48a2-a28f-05e6e65a9bb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:36.394896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d61c4fd9-fc59-48a2-a28f-05e6e65a9bb4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:36.396400 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d61c4fd9-fc59-48a2-a28f-05e6e65a9bb4 admin admin] 10.222.0.36 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1053450 May 25 15:34:38.514957 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38666) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:38.621734 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8488faba-7f9d-40bf-9476-c3e4d2d1e8e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:38.622193 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8488faba-7f9d-40bf-9476-c3e4d2d1e8e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:38.623661 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-8488faba-7f9d-40bf-9476-c3e4d2d1e8e0 admin admin] 10.222.0.36 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1077158 May 25 15:34:40.728042 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38676) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:40.833995 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c611b9d7-364d-4ef2-9c28-60da5ce6d2e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:40.835352 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c611b9d7-364d-4ef2-9c28-60da5ce6d2e0 admin admin] 10.222.0.36 "GET /v2.0/subnets/50df14d4-f3c9-4b59-bc45-104d1a09b685 HTTP/1.1" status: 200 len: 868 time: 0.1063528 May 25 15:34:42.930142 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38686) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:34:43.032702 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0eafcf7-f84e-4aa7-824f-991aa0d83e66 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:34:43.033984 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a0eafcf7-f84e-4aa7-824f-991aa0d83e66 admin admin] 10.222.0.36 "GET /v2.0/subnets/ffbac48b-f0bf-4296-959e-36eeb4ffe30f HTTP/1.1" status: 200 len: 816 time: 0.1028478 May 25 15:34:59.961607 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2baece28-c342-441e-b72c-4a58e74368cf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:02.585126 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:02.632978 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-bec127e4-f2dc-4af3-ad7f-32df84b1e735 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:03.387017 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:05.099476 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:06.532729 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38730) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:06.580549 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-b62f19cc-a69c-4709-b190-66e120239d14 admin admin] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:35:06.581528 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b62f19cc-a69c-4709-b190-66e120239d14 admin admin] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0478947 May 25 15:35:08.791647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38740) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:08.857465 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.pecan_wsgi.hooks.translation [None req-7f2ca046-5b8c-4cbb-84c5-07a6f5412fdd admin admin] GET failed (client error): The resource could not be found. May 25 15:35:08.858689 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-7f2ca046-5b8c-4cbb-84c5-07a6f5412fdd admin admin] 10.222.0.36 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0660880 May 25 15:35:08.982318 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f393d3c-df1f-43da-a4d5-0535906f20ff admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:08.983693 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5f393d3c-df1f-43da-a4d5-0535906f20ff admin admin] 10.222.0.36 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1211674 May 25 15:35:09.103970 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:35:11.158851 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38750) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:11.207159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:35:11.212608 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:35:11.222465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:35:11.232045 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Made reservation on behalf of e7c1839e767741ad9efeddce513f9b35 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:35:11.235034 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:11.322533 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING neutron.services.revisions.revision_plugin [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Could not find related network for resource to bump revision. May 25 15:35:11.334209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 386} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:35:11.343632 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:11.343936 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Added segment 7d7df0a9-4395-4f15-afdc-06bc8dc43302 of type vlan for network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 May 25 15:35:11.368312 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:11.396702 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:11.397957 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:11.398529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:11.402864 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:11.498538 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3386264 May 25 15:35:11.501685 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Pushing event updated for resources: {'Network': ['ID=4fce4df0-5246-42d6-ba2e-1012d59d04c0,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:11.504953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:11.513724 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:35:13.637427 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38760) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:35:13.702873 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.pecan_wsgi.hooks.translation [None req-ce4d7dd9-1d80-4c64-8825-9019ac96f6f1 admin admin] GET failed (client error): The resource could not be found. May 25 15:35:13.703373 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ce4d7dd9-1d80-4c64-8825-9019ac96f6f1 admin admin] Synchronizing usage tracker for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:35:13.718488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ce4d7dd9-1d80-4c64-8825-9019ac96f6f1 admin admin] Unset dirty status for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:35:13.719580 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ce4d7dd9-1d80-4c64-8825-9019ac96f6f1 admin admin] 10.222.0.36 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0811999 May 25 15:35:13.822320 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d27a52c5-aa50-43c6-be6b-3ad8849a1340 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:13.823672 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d27a52c5-aa50-43c6-be6b-3ad8849a1340 admin admin] 10.222.0.36 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1001973 May 25 15:35:13.833533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'ip_version': 4, 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:35:13.837781 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:35:13.847133 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:35:13.855964 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Made reservation on behalf of e7c1839e767741ad9efeddce513f9b35 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:35:13.858119 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:14.269254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:14.273536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:14.348705 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Pushing event updated for resources: {'Subnet': ['ID=935cff87-3f66-4e7b-bcf5-f2c231ee8848,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:14.352904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:14.362777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Checking segment: {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:35:14.363129 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Network hostable DHCP agents. Network: 4fce4df0-5246-42d6-ba2e-1012d59d04c0, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:35:14.379965 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:35:14.388588 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 4fce4df0-5246-42d6-ba2e-1012d59d04c0) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:35:14.392552 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:35:14.393134 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:14.398544 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5992694-8c50-4441-a3a5-8c66977fc4fe None None] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:35:14.416167 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5859697 May 25 15:35:14.632971 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-4fce4df0-5246-42d6-ba2e-1012d59d04c0', 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0', 'tenant_id': 'e7c1839e767741ad9efeddce513f9b35', 'fixed_ips': [{'subnet_id': '935cff87-3f66-4e7b-bcf5-f2c231ee8848'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:35:14.633800 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:14.789573 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Allocated IP 192.168.233.2 (4fce4df0-5246-42d6-ba2e-1012d59d04c0/935cff87-3f66-4e7b-bcf5-f2c231ee8848/ebb8a35c-0430-449b-ae2f-e4de7c66cc01) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:35:14.992822 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:15.003225 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Transition to ACTIVE for port object ebb8a35c-0430-449b-ae2f-e4de7c66cc01 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:35:15.022031 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Transition to ACTIVE for port object ebb8a35c-0430-449b-ae2f-e4de7c66cc01 will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:35:15.027491 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:15.032987 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:15.097441 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:35:15.098567 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:35:15.102282 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:35:15.135237 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Pushing event updated for resources: {'Port': ['ID=ebb8a35c-0430-449b-ae2f-e4de7c66cc01,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:15.173758 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.174095 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.174431 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.174754 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.175070 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.175393 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.175705 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.176048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.176377 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.176694 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.177022 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.177331 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:35:15.185137 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:15.205129 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Attempting to bind port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:35:15.205489 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Attempting to bind port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:35:15.205845 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Attempting to bind port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 on network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:35:15.211134 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 35, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:35:15.211495 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Checking segment: {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:35:15.211962 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:15.212313 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Bound using segment: {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:35:15.212771 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Bound port: ebb8a35c-0430-449b-ae2f-e4de7c66cc01, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:35:15.213138 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:15.303836 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] For port ebb8a35c-0430-449b-ae2f-e4de7c66cc01, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:35:15.307549 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] For port ebb8a35c-0430-449b-ae2f-e4de7c66cc01, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ebb8a35c-0430-449b-ae2f-e4de7c66cc01,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:35:15.311975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:15.315989 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:15.390821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Pushing event updated for resources: {'Port': ['ID=ebb8a35c-0430-449b-ae2f-e4de7c66cc01,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:15.393973 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:16.227520 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a427787-2ffa-4a63-a3f9-d4137998cc39 None None] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:35:16.310277 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-6c1b0628-6a35-4de9-99a9-128a000b6413 None None] Provisioning for port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:35:16.511019 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ebb8a35c-0430-449b-ae2f-e4de7c66cc01 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:35:16.589154 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:35:16.595151 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:35:16.595689 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:16.718937 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:16.762566 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-7ee79eac-3c00-4147-aa2b-8264bce0daf9 None None] Provisioning complete for port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:35:16.762862 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7ee79eac-3c00-4147-aa2b-8264bce0daf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:16.809395 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port ebb8a35c-0430-449b-ae2f-e4de7c66cc01, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ebb8a35c-0430-449b-ae2f-e4de7c66cc01,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:35:16.824200 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:16.830106 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:35:16.907941 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=ebb8a35c-0430-449b-ae2f-e4de7c66cc01,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:35:16.933794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:35:18.477550 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ebb8a35c-0430-449b-ae2f-e4de7c66cc01 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:35:18.544201 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port ebb8a35c-0430-449b-ae2f-e4de7c66cc01 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:35:18.544580 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:29.942633 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-70ac6db6-8fde-4b75-8655-c2e55622f138 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:32.587842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:32.634915 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cff11cd5-f1a7-4ed5-8409-1df2e521d3e5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:33.391285 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:35.103070 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:35:46.102929 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:35:59.945316 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d49e4580-3bd0-4f0a-ba69-af077101848d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:02.590023 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:02.637595 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-67964c2d-8891-470f-a45d-874f331694ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:03.392373 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:05.108535 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:23.101836 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:36:26.791377 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38810) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:26.797915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [None req-07ed1c70-5b99-42f0-84a8-56a2afc35e56 tempest-verify_tempest_config-2045977239 tempest-verify_tempest_config-2045977239-project] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:36:26.798842 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-07ed1c70-5b99-42f0-84a8-56a2afc35e56 tempest-verify_tempest_config-2045977239 tempest-verify_tempest_config-2045977239-project] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0064476 May 25 15:36:27.101636 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38828) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:27.214948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.229144 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:36:27.234207 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Usage tracker for resource:security_group_rule and tenant:da8d62361e2d4bf6b200afde84bc6849 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:36:27.236926 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:36:27.242489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:36:27.329078 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.333079 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.340187 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:27.378230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Synchronizing usage tracker for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:36:27.380607 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3218de9-0862-4147-ade9-a8a21031375d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:27.391480 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.391830 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.392182 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.392502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.392816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.393144 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.393458 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.393767 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.394075 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.394381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.394684 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.394985 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:36:27.398673 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:27.408869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Unset dirty status for tenant:e7c1839e767741ad9efeddce513f9b35 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:36:27.412655 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=da8d62361e2d4bf6b200afde84bc6849&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3075278 May 25 15:36:27.412802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38834) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:36:27.468474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.492825 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.588755 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.592501 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2e4788ba-bc91-463a-bf36-ef213476243b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:36:27.602783 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3218de9-0862-4147-ade9-a8a21031375d,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:36:27.607340 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:36:27.610113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:27.611193 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/d3218de9-0862-4147-ade9-a8a21031375d HTTP/1.1" status: 204 len: 168 time: 0.1974800 May 25 15:36:29.949964 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-5258cf34-b36a-45ba-8243-7395ace814da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:32.592997 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:32.640846 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b922d4b1-bf29-4b4b-a5c2-e53d1aead411 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:33.395577 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:35.112603 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:36:59.950853 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-15205a14-52ad-4a5f-b6be-51fa8420edfe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:00.100669 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:37:02.594140 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:02.640683 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-e352cd94-dc8a-42ee-bf20-eeca9aa18261 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:03.398744 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:05.114318 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:29.952090 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6e35d0ff-d57a-4bef-8d59-218bc9a29f29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:32.595449 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:32.641441 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-14635f0b-74d9-4815-b329-b2848fe2b49d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:33.401649 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:35.118208 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:37:37.099242 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 5 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:37:59.954231 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7b54f58c-aed6-4ae1-9e7d-0c75b5068328 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:02.603138 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:02.646074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9249eeb3-b813-4497-a909-7d22c3ae3812 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:03.403162 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:05.122545 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:10.549878 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454'] for agent, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:12.608655 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38886) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:38:12.722833 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3269536b-3e79-4208-92cd-b1a0b4ac68fc admin admin] 10.222.0.36 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1130991 May 25 15:38:14.098262 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:38:14.850910 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 38896) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:38:14.905949 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e1394f63-b7a1-42e9-b376-d4f204967012 admin admin] 10.222.0.36 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0539663 May 25 15:38:29.957106 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-86a65ff5-c608-4409-bde5-082c8401e83c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:32.594713 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:32.647312 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0423ac08-467f-44b6-ba7b-0f8f0327332e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:33.405632 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:35.125954 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:40.534267 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:38:51.097076 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:38:59.958527 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-e2d0f8d7-a7e5-47f5-aa0b-379ff33efd1c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:02.595993 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:02.647922 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b9e48188-5c21-4938-ba6a-6d4c00b56da3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:03.409542 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:05.132959 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:10.550532 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:28.096254 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:39:29.960368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-ab665677-be89-46f5-8117-d141f2da98d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:32.599555 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:32.649554 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9951cb04-f4de-4cf1-8752-a889ff8f78ee None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:33.412025 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:35.136082 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:40.548355 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.005188 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39116) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:48.152614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39130) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:48.176248 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39138) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:48.188877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39144) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:48.269907 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1482065026-network', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:48.274613 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.278407 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Usage tracker for resource:network and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.281653 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.287433 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.305942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Made reservation on behalf of 42ea914db4fc4438a1d50bfff262a6e8 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:48.308281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.321880 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.336169 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.340430 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.343185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.348875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.436016 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.442490 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.448413 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92c736b5-ab7a-4bd2-9160-de5215cd4b2b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:48.479449 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a299b04f-f889-4ee3-90c4-b6d9f66140ea,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:48.491286 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1727367742-network', 'tenant_id': '6defbd5b403b44ac8c53cbf324a7f8c9'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:48.502916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.503247 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.504755 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.504924 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.505232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.505712 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.506152 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.506358 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.506875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.507209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.507557 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.508394 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Tracked resource versions report: May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: pushed versions: May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: { 'AddressGroup': {'1.2'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'ConntrackHelper': {'1.0'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Log': {'1.0'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Network': {'1.1'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Port': {'1.7'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'PortForwarding': {'1.2'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'QosPolicy': {'1.8'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroup': {'1.4'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroupRule': {'1.2'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SubPort': {'1.0'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Subnet': {'1.1'}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Trunk': {'1.1'}} May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: consumer versions: May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: HyperV agent@hv-cinder-79123: {}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'ConntrackHelper': '1.0', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Log': '1.0', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Network': '1.1', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Port': '1.7', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'PortForwarding': '1.2', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'QosPolicy': '1.8', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroup': '1.4', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SecurityGroupRule': '1.2', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'SubPort': '1.0', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Subnet': '1.1', May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: 'Trunk': '1.1'}} May 25 15:39:48.509571 dv-cinder-791239-3-iscsi neutron-server[98463]: {{(pid=98463) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:39:48.512250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 364} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:39:48.517536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-network', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:48.524073 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.527802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Usage tracker for resource:network and tenant:0a695c168ea64d4f96c9e8751a6875ca is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.530824 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.539765 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:48.540629 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.553155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.553479 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Added segment c300b79c-ebf3-4aef-a927-fb0aa4b1ff23 of type vlan for network 320ad3f5-0f83-444c-8df0-70303c7a4446 May 25 15:39:48.559355 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-689648399-network', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:48.569074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.575114 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.578867 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Usage tracker for resource:network and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.584843 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.592107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.599455 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Made reservation on behalf of 0a695c168ea64d4f96c9e8751a6875ca for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:48.601821 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.616777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.630601 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Usage tracker for resource:network and tenant:6defbd5b403b44ac8c53cbf324a7f8c9 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.636435 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.640214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Usage tracker for resource:security_group_rule and tenant:0a695c168ea64d4f96c9e8751a6875ca is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.642996 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.650084 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.654163 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Made reservation on behalf of c00f6cd8c3154d2f835d5f59da9cc7e3 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:48.656062 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.670373 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.725678 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:48.779638 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.781395 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.797146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.810664 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.815428 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:48.829948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 355} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:39:48.839473 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.839988 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Added segment b90cd672-6077-4a06-b3ec-e05219e8e214 of type vlan for network db198222-1495-44ec-99cd-cc38de1c71df May 25 15:39:48.865688 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.898007 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=479311f7-8688-437c-b1d8-2645298577af,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:48.920098 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:48.923370 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Made reservation on behalf of 6defbd5b403b44ac8c53cbf324a7f8c9 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:48.926295 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.943210 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:48.944540 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.945986 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:48.952577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:48.962573 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:48.968388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:48.969225 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.002080 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:49.102439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:49.105784 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.db.resource_extend [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:39:49.128116 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Pushing event updated for resources: {'Network': ['ID=db198222-1495-44ec-99cd-cc38de1c71df,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:49.145330 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network db198222-1495-44ec-99cd-cc38de1c71df details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:39:49.157869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:49.267049 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.0895011 May 25 15:39:49.270639 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:49.270770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39182) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:49.277107 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Request body: {'subnet': {'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-subnet', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:49.279118 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.quota [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Loaded quota_driver: . May 25 15:39:49.283737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Usage tracker for resource:security_group_rule and tenant:6defbd5b403b44ac8c53cbf324a7f8c9 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:49.294789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:49.295393 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:49.309289 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:49.313466 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Usage tracker for resource:subnet and tenant:0a695c168ea64d4f96c9e8751a6875ca is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:49.317784 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:49.336644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:49.370661 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Made reservation on behalf of 0a695c168ea64d4f96c9e8751a6875ca for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:49.371663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.375265 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.406270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:49.407005 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.430050 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:49.664295 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Pushing event updated for resources: {'Network': ['ID=320ad3f5-0f83-444c-8df0-70303c7a4446,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:49.667277 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:49.675321 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:39:49.694560 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6881323 May 25 15:39:49.695848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39206) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:49.720340 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Request body: {'subnet': {'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1482065026-subnet', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:49.730432 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:49.760102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Usage tracker for resource:subnet and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:49.763254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.767819 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:49.773203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.774804 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.781087 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:49.784282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1b7f849c-c7ba-4d6c-99b1-e63ab5b41f81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:49.796998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.829307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 389} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:39:49.848764 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 353} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:39:49.854833 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Made reservation on behalf of 42ea914db4fc4438a1d50bfff262a6e8 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:49.857183 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.881280 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.881615 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Added segment 8a902213-8048-4a9b-bc50-c79c837b967d of type vlan for network 76bea034-0890-4bf6-b793-280aaec1a32c May 25 15:39:49.970281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c64c8c69-bf12-464b-a985-719d420640f2,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:49.974102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:49.982875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:49.983213 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Added segment feccb394-ccb2-48ac-98c1-f206da890375 of type vlan for network d995c251-7c0b-4025-9654-f6a6946e8b02 May 25 15:39:49.984660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.145s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:50.070125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6dd46eab-149a-48fb-a373-ddf68bb4aeb9,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:50.073363 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:50.077014 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.084375 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.091184 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.099085 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:50.145866 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.185647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:50.186253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.189918 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9a7fde32-dada-41b0-871f-c1e5ef76bcc1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:50.209173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Checking segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:50.209820 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Network hostable DHCP agents. Network: db198222-1495-44ec-99cd-cc38de1c71df, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:39:50.216057 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Pushing event updated for resources: {'Subnet': ['ID=eae8c611-60f5-420f-b883-17fbae330f18,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:50.219200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.230368 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.230942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.231425 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.231911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.232370 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.232860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.233341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.233819 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.234316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.234781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.235245 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.235725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Tracked resource versions report: May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: pushed versions: May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: { 'AddressGroup': {'1.2'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'ConntrackHelper': {'1.0'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Log': {'1.0'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Network': {'1.1'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Port': {'1.7'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'PortForwarding': {'1.2'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'QosPolicy': {'1.8'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SecurityGroup': {'1.4'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SecurityGroupRule': {'1.2'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SubPort': {'1.0'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Subnet': {'1.1'}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Trunk': {'1.1'}} May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: consumer versions: May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: HyperV agent@hv-cinder-79123: {}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'ConntrackHelper': '1.0', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Log': '1.0', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Network': '1.1', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Port': '1.7', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'PortForwarding': '1.2', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'QosPolicy': '1.8', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SecurityGroup': '1.4', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SecurityGroupRule': '1.2', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'SubPort': '1.0', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Subnet': '1.1', May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: 'Trunk': '1.1'}} May 25 15:39:50.237161 dv-cinder-791239-3-iscsi neutron-server[98462]: {{(pid=98462) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:39:50.281921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:50.285086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Network db198222-1495-44ec-99cd-cc38de1c71df is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:39:50.287711 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:50.288217 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.300735 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, db198222-1495-44ec-99cd-cc38de1c71df) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:50.308966 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:50.309926 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.310684 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2db5d2f9-ade8-49e0-96b0-4b1a3e0b34f2 None None] Network db198222-1495-44ec-99cd-cc38de1c71df requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:50.350443 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Pushing event updated for resources: {'Network': ['ID=76bea034-0890-4bf6-b793-280aaec1a32c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:50.351391 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:50.351882 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.0798409 May 25 15:39:50.352795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39230) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:50.353001 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.1633191 May 25 15:39:50.355157 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.039s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:50.356314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39234) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:50.364145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:50.364926 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 76bea034-0890-4bf6-b793-280aaec1a32c details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:39:50.370476 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:50.375630 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Usage tracker for resource:router and tenant:0a695c168ea64d4f96c9e8751a6875ca is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:50.380001 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:50.388541 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.2348740 May 25 15:39:50.389115 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:50.406840 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Request body: {'subnet': {'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-subnet', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:50.411512 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39238) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:50.422490 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Request body: {'subnet': {'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1727367742-subnet', 'tenant_id': '6defbd5b403b44ac8c53cbf324a7f8c9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:50.429172 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.431430 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.439449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:50.448602 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Usage tracker for resource:subnet and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:50.454209 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:50.469088 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:50.480148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:50.494923 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.586523 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Pushing event updated for resources: {'Network': ['ID=d995c251-7c0b-4025-9654-f6a6946e8b02,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:50.590270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Usage tracker for resource:subnet and tenant:6defbd5b403b44ac8c53cbf324a7f8c9 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:50.603322 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Made reservation on behalf of c00f6cd8c3154d2f835d5f59da9cc7e3 for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:50.605727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:50.606776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.619302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network d995c251-7c0b-4025-9654-f6a6946e8b02 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:39:50.622792 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:50.642971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:50.945052 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbcb6dda-ace6-4ae0-970f-11cc78938701 None None] Network db198222-1495-44ec-99cd-cc38de1c71df requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:50.965441 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:50.969988 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:51.053144 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Pushing event updated for resources: {'Subnet': ['ID=02ba8877-ef07-4ef0-b677-beca89c84dcb,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:51.055812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:51.065151 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Checking segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:51.065532 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.065637 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Network hostable DHCP agents. Network: 320ad3f5-0f83-444c-8df0-70303c7a4446, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:39:51.077772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Made reservation on behalf of 6defbd5b403b44ac8c53cbf324a7f8c9 for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:39:51.080538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Notify callbacks [] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.094269 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:39:51.114882 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 320ad3f5-0f83-444c-8df0-70303c7a4446) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:51.119896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:51.120510 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.127836 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffa1db30-6b9e-4453-a846-a51349d7c251 None None] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:51.161644 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.4639719 May 25 15:39:51.162267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39264) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:51.167582 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:51.202754 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:51.215786 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Usage tracker for resource:router and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:51.222979 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:51.234829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:51.259068 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.260797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.313743 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.543270 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-320ad3f5-0f83-444c-8df0-70303c7a4446', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:39:51.544267 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.660155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:51.751733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Allocated IP 172.20.0.2 (320ad3f5-0f83-444c-8df0-70303c7a4446/02ba8877-ef07-4ef0-b677-beca89c84dcb/e879beca-d836-4e54-858e-1247ed340ef1) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:52.022520 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.037454 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Transition to ACTIVE for port object e879beca-d836-4e54-858e-1247ed340ef1 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:52.074015 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.078684 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Transition to ACTIVE for port object e879beca-d836-4e54-858e-1247ed340ef1 will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:52.086004 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.094190 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:52.146812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.214123 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:52.223979 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:52.234433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:52.344444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Allocated IP 172.27.0.226 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/c910cae2-a50e-4f9c-b6ab-2bc6ee721e26) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:52.358851 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Pushing event updated for resources: {'Port': ['ID=e879beca-d836-4e54-858e-1247ed340ef1,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:52.397032 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.397395 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.397707 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.398035 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.398469 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.398797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.399116 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.399434 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.399772 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.400119 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.406234 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.406234 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Tracked resource versions report: May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: pushed versions: May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: { 'AddressGroup': {'1.2'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'ConntrackHelper': {'1.0'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Log': {'1.0'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Network': {'1.1'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Port': {'1.7'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'PortForwarding': {'1.2'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'QosPolicy': {'1.8'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroup': {'1.4'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroupRule': {'1.2'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SubPort': {'1.0'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Subnet': {'1.1'}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Trunk': {'1.1'}} May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: consumer versions: May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: HyperV agent@hv-cinder-79123: {}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'ConntrackHelper': '1.0', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Log': '1.0', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Network': '1.1', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Port': '1.7', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'PortForwarding': '1.2', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'QosPolicy': '1.8', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroup': '1.4', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SecurityGroupRule': '1.2', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'SubPort': '1.0', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Subnet': '1.1', May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: 'Trunk': '1.1'}} May 25 15:39:52.407433 dv-cinder-791239-3-iscsi neutron-server[98464]: {{(pid=98464) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:39:52.414478 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:52.418136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.418909 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Attempting to bind port e879beca-d836-4e54-858e-1247ed340ef1 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:39:52.419464 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Attempting to bind port e879beca-d836-4e54-858e-1247ed340ef1 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:39:52.421003 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Attempting to bind port e879beca-d836-4e54-858e-1247ed340ef1 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:39:52.448214 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 39, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:39:52.448730 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Checking segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:52.449248 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.449734 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Bound using segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:39:52.450334 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Bound port: e879beca-d836-4e54-858e-1247ed340ef1, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:39:52.450810 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.505151 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.521722 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.556870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.569651 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:52.660568 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] For port e879beca-d836-4e54-858e-1247ed340ef1, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:39:52.664238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] For port e879beca-d836-4e54-858e-1247ed340ef1, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e879beca-d836-4e54-858e-1247ed340ef1,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:39:52.667190 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Pushing event updated for resources: {'Port': ['ID=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:52.670466 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.674992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:52.677885 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:52.680180 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:52.681577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:52.689094 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:52.773092 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Pushing event updated for resources: {'Port': ['ID=e879beca-d836-4e54-858e-1247ed340ef1,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:52.799665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:52.806934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Allocated IP 172.27.0.171 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/4f835a90-3c22-4814-8461-fb62812ddc7d) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:52.866804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:52.903472 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:53.192292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=42c665bd-6d57-4ffa-8c85-4ad61909dc6f,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:53.205076 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.206380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.303s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:53.217519 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Checking segment: {'id': 'feccb394-ccb2-48ac-98c1-f206da890375', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:53.217927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Network hostable DHCP agents. Network: d995c251-7c0b-4025-9654-f6a6946e8b02, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:39:53.227220 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:53.288201 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.288771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.334146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Network d995c251-7c0b-4025-9654-f6a6946e8b02 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:39:53.354908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2ce66291-0ef8-4b15-9e67-ba32027661fc,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:53.358629 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:53.363904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, d995c251-7c0b-4025-9654-f6a6946e8b02) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:53.370355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Checking segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:53.370765 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Network hostable DHCP agents. Network: 76bea034-0890-4bf6-b793-280aaec1a32c, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:39:53.371539 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-465546b3-6df5-4cad-8540-862c2b0b3600 None None] Network d995c251-7c0b-4025-9654-f6a6946e8b02 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:53.381763 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:53.382355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.448505 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-0a099579-ae06-47c2-aa39-8e2deb6456e1 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 3.0350614 May 25 15:39:53.450960 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.452102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Network 76bea034-0890-4bf6-b793-280aaec1a32c is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:39:53.480059 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.004s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:53.549261 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 76bea034-0890-4bf6-b793-280aaec1a32c) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:53.564750 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:53.565449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.568884 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ba82f9f-6a8b-4289-88cf-ddb88c3148d6 None None] Network 76bea034-0890-4bf6-b793-280aaec1a32c requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:53.584687 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:53.596184 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:53.603027 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:53.726154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Pushing event updated for resources: {'Port': ['ID=4f835a90-3c22-4814-8461-fb62812ddc7d,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:53.835113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.839021 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 3.4810255 May 25 15:39:53.861100 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.381s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:53.862089 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39348) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:53.873156 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6007da34-1c45-4944-aa53-31868316c5f8 None None] Network d995c251-7c0b-4025-9654-f6a6946e8b02 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:53.879245 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:39:53.947667 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:53.958838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Usage tracker for resource:router and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:53.962114 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:53.968510 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:53.987776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:53.989430 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.095529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39368) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:54.099699 dv-cinder-791239-3-iscsi neutron-server[98463]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 25 15:39:54.115813 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.212695 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-76bea034-0890-4bf6-b793-280aaec1a32c', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:39:54.213511 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.230733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-62006bfb-d772-426c-ac16-bfb83843116f None None] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:54.257668 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-abe621f0-5f07-4ed9-9224-14a219db2cff tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:39:54.258624 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-abe621f0-5f07-4ed9-9224-14a219db2cff tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Synchronizing usage tracker for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:39:54.294724 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-abe621f0-5f07-4ed9-9224-14a219db2cff tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Unset dirty status for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:39:54.301350 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-abe621f0-5f07-4ed9-9224-14a219db2cff tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/networks?id=d995c251-7c0b-4025-9654-f6a6946e8b02 HTTP/1.1" status: 200 len: 812 time: 0.2049212 May 25 15:39:54.309604 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:39:54.322351 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-4e1526f4-166f-4325-aa30-75f1870d85e9 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/quotas/6defbd5b403b44ac8c53cbf324a7f8c9 HTTP/1.1" status: 200 len: 375 time: 0.0201433 May 25 15:39:54.427018 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-254de529-9ddb-4c60-9abd-b80fb19579ac tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=6defbd5b403b44ac8c53cbf324a7f8c9&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1036308 May 25 15:39:54.453497 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-9c511ca9-734f-471b-9670-ba460aac8ab3 None None] Provisioning for port e879beca-d836-4e54-858e-1247ed340ef1 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:39:54.578641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Allocated IP 172.20.0.2 (76bea034-0890-4bf6-b793-280aaec1a32c/2ce66291-0ef8-4b15-9e67-ba32027661fc/71d9316f-ff03-4b95-bed2-2b2b160077db) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:54.592697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.596258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.602429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:39:54.615032 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:39:54.632808 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:39:54.633691 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:54.657020 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:54.658386 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 3.4951596 May 25 15:39:54.661702 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39382) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:54.826311 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e879beca-d836-4e54-858e-1247ed340ef1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:39:54.925992 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:39:54.969274 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-f7ae0fa5-9d83-4c4f-af9c-6df0efedd94f service neutron] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:39:54.970242 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-f7ae0fa5-9d83-4c4f-af9c-6df0efedd94f service neutron] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.4174201 May 25 15:39:55.122610 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.151840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port e879beca-d836-4e54-858e-1247ed340ef1 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:39:55.177814 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e879beca-d836-4e54-858e-1247ed340ef1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:55.178278 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.242390 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.405836 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Transition to ACTIVE for port object 71d9316f-ff03-4b95-bed2-2b2b160077db will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:55.441206 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Transition to ACTIVE for port object 71d9316f-ff03-4b95-bed2-2b2b160077db will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:55.464818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.547193 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-69c685f9-cd7c-4e8a-8756-940106605949 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:55.557760 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:52Z', 'revision_number': 3, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:55.562152 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:39:55.562711 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Updating router 927291b5-83b6-4e30-b11f-71ca95ddef81 port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:39:55.586739 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.622201 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-1532605d-5633-4416-9467-1bff7419b19f service neutron] 10.222.0.36 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6426411 May 25 15:39:55.630011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.630605 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.642760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Network 76bea034-0890-4bf6-b793-280aaec1a32c is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:55.660932 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:55.667024 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.681172 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:55.685523 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-cd5551d7-3b0b-488e-b26c-0b85dfd5b32e None None] Provisioning complete for port e879beca-d836-4e54-858e-1247ed340ef1 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:55.686429 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cd5551d7-3b0b-488e-b26c-0b85dfd5b32e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.711889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Router 11ba60b2-4c9b-4c79-921e-91355709c4b2 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98462) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:39:55.725165 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Pushing event updated for resources: {'Port': ['ID=71d9316f-ff03-4b95-bed2-2b2b160077db,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:55.773367 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port e879beca-d836-4e54-858e-1247ed340ef1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e879beca-d836-4e54-858e-1247ed340ef1,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:39:55.774849 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:55.792456 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.806469 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9158cd83-a8e7-40a1-bf13-34f20ca12b8e service neutron] 10.222.0.36 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1535518 May 25 15:39:55.844530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:55.925626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Attempting to bind port 71d9316f-ff03-4b95-bed2-2b2b160077db on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:39:55.925898 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Attempting to bind port 71d9316f-ff03-4b95-bed2-2b2b160077db by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:39:55.926465 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Attempting to bind port 71d9316f-ff03-4b95-bed2-2b2b160077db on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:39:55.951588 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 39, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:39:55.951911 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Checking segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:55.952332 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:55.952822 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Bound using segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:39:55.953392 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Bound port: 71d9316f-ff03-4b95-bed2-2b2b160077db, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:39:55.958248 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.067727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.125944 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:39:56.137762 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=e879beca-d836-4e54-858e-1247ed340ef1,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:56.161617 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Sync routers for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:39:56.169692 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:56.201531 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.205486 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 5.8485818 May 25 15:39:56.207824 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39426) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:56.254211 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.268754 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Transition to ACTIVE for port object c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:56.279571 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.291212 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:56.305339 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:39:56.320669 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:56.385886 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Pushing event updated for resources: {'Port': ['ID=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,revision_number=2']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:56.426781 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.427116 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.427463 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.427797 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.428902 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.429510 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.429850 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.430430 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.430623 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.430955 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.431350 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.431716 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Tracked resource versions report: May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: pushed versions: May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: { 'AddressGroup': {'1.2'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'ConntrackHelper': {'1.0'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Log': {'1.0'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Network': {'1.1'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Port': {'1.7'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'PortForwarding': {'1.2'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'QosPolicy': {'1.8'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroup': {'1.4'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroupRule': {'1.2'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SubPort': {'1.0'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Subnet': {'1.1'}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Trunk': {'1.1'}} May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: consumer versions: May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: { DHCP agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: HyperV agent@hv-cinder-79123: {}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: L3 agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: Metadata agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: Metering agent@dv-cinder-791239-3-iscsi: {}, May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: Open vSwitch agent@dv-cinder-791239-3-iscsi: { 'AddressGroup': '1.2', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'ConntrackHelper': '1.0', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Log': '1.0', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Network': '1.1', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Port': '1.7', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'PortForwarding': '1.2', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'QosPolicy': '1.8', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroup': '1.4', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SecurityGroupRule': '1.2', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'SubPort': '1.0', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Subnet': '1.1', May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: 'Trunk': '1.1'}} May 25 15:39:56.432977 dv-cinder-791239-3-iscsi neutron-server[98465]: {{(pid=98465) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 15:39:56.436771 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Attempting to bind port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:39:56.437355 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Attempting to bind port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:39:56.437853 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Attempting to bind port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:39:56.446516 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:56.447795 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 39, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:39:56.448426 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:56.448840 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.449251 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:39:56.452183 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Bound port: c910cae2-a50e-4f9c-b6ab-2bc6ee721e26, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:39:56.452607 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.554539 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] For port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:39:56.558546 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] For port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:39:56.568925 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:56.584441 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:56.762034 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Pushing event updated for resources: {'Port': ['ID=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:56.787125 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7893b002-5454-4379-8ac7-bc4a895d8452 req-6b1cad81-1d88-4d15-beae-1b6eb887c50d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.1604819 May 25 15:39:56.821484 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:39:56.822867 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:56.830383 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39454) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:56.842822 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Allocated IP 172.20.0.1 (320ad3f5-0f83-444c-8df0-70303c7a4446/02ba8877-ef07-4ef0-b677-beca89c84dcb/457c32e2-b449-47fd-84fd-f6192b685bb2) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:56.928060 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Allocated IP 172.27.0.190 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/7de68007-656f-4ebe-b48c-f94f0b3d44e1) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:39:56.950152 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:39:57.067626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e879beca-d836-4e54-858e-1247ed340ef1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:39:57.134985 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.151901 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:39:57.206216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:39:57.252769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Usage tracker for resource:security_group_rule and tenant:d94acf770d7d431a9ad1dc4f63559f77 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:39:57.260540 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.274497 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:39:57.299564 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:39:57.330688 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.746s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:57.343026 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Transition to ACTIVE for port object 457c32e2-b449-47fd-84fd-f6192b685bb2 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:57.415677 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.428947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-698dc250-a231-4a96-975c-9d930c1c053a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:57.499526 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] For port 71d9316f-ff03-4b95-bed2-2b2b160077db, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:39:57.506731 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:57.511563 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:57.530680 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:57.531156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.561794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] For port 71d9316f-ff03-4b95-bed2-2b2b160077db, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=71d9316f-ff03-4b95-bed2-2b2b160077db,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:39:57.574275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.624442 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.633053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.650725 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:57.738393 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:52Z', 'revision_number': 3, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:57.752642 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fbdde6c5-7dca-4eff-afe6-c035aac2befc None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:52Z', 'revision_number': 3, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:39:57.824952 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Pushing event updated for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:57.824952 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.827934 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.399s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:57.844097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:57.895495 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e879beca-d836-4e54-858e-1247ed340ef1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:57.895986 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3812981b-4d7d-4f4f-b553-7ec6857ebc47,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:57.898600 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.936026 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.948383 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:57.973011 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-16dee081-4633-4255-a918-aa148f20421f req-63071791-d3a3-4c93-a017-5fdb99cd6663 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.0734231 May 25 15:39:57.976533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:57.985091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:57.997395 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=d94acf770d7d431a9ad1dc4f63559f77&name=default HTTP/1.1" status: 200 len: 2975 time: 1.1630478 May 25 15:39:58.000081 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39512) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:39:58.119474 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Pushing event updated for resources: {'Port': ['ID=71d9316f-ff03-4b95-bed2-2b2b160077db,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:58.126051 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.476s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:58.135262 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:39:54Z', 'revision_number': 3, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:52Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:39:58.154430 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Checking router: 11ba60b2-4c9b-4c79-921e-91355709c4b2 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:39:58.154821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Updating router 11ba60b2-4c9b-4c79-921e-91355709c4b2 port 4f835a90-3c22-4814-8461-fb62812ddc7d binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:39:58.201270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:58.240087 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.242625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:58.252097 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:39:58.323112 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.361221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a46f74e8-788a-46ca-93eb-7dd05839d77d None None] Provisioning for port 457c32e2-b449-47fd-84fd-f6192b685bb2 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:39:58.377913 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a46f74e8-788a-46ca-93eb-7dd05839d77d None None] Provisioning complete for port 457c32e2-b449-47fd-84fd-f6192b685bb2 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:58.378840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a46f74e8-788a-46ca-93eb-7dd05839d77d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.384173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.518208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.520396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.523714 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5ab8a8c3-69dc-44eb-8c41-794bd1f577fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:58.545435 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.546763 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3812981b-4d7d-4f4f-b553-7ec6857ebc47,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:58.548831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.564216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:58.566006 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:58.610152 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Pushing event updated for resources: {'Port': ['ID=7de68007-656f-4ebe-b48c-f94f0b3d44e1,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:58.616514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.631s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:58.710921 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Pushing event updated for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:58.733367 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:58.738316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:58.742443 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/3812981b-4d7d-4f4f-b553-7ec6857ebc47 HTTP/1.1" status: 204 len: 168 time: 0.7413759 May 25 15:39:58.744641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-a46f74e8-788a-46ca-93eb-7dd05839d77d None None] Port 457c32e2-b449-47fd-84fd-f6192b685bb2 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:39:59.000388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:39:59.001749 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:39:59.004284 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:39:59.240278 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.326999 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.346459 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:39:59.401111 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:59.401328 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.444444 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-302d8141-dbe2-4330-8748-ca1e32f7c78e req-56326297-3546-40d6-ba4c-927268a3a0f8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.1731024 May 25 15:39:59.511587 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:39:59.550881 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.556282 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-620ac2f5-24a1-4809-a351-59b269fe450d None None] Provisioning complete for port 457c32e2-b449-47fd-84fd-f6192b685bb2 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:39:59.556973 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-620ac2f5-24a1-4809-a351-59b269fe450d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.597740 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Transition to ACTIVE for port object 4f835a90-3c22-4814-8461-fb62812ddc7d will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:39:59.676775 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.693359 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:39:59.740659 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-620ac2f5-24a1-4809-a351-59b269fe450d None None] Port 457c32e2-b449-47fd-84fd-f6192b685bb2 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:39:59.746878 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-272b5e6a-408f-461b-91b6-6c396060e9f0 None None] Network 76bea034-0890-4bf6-b793-280aaec1a32c requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:39:59.789209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:39:59.796421 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] 10.222.0.36 "PUT /v2.0/routers/927291b5-83b6-4e30-b11f-71ca95ddef81/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.1328681 May 25 15:39:59.843481 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.887199 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Attempting to bind port 4f835a90-3c22-4814-8461-fb62812ddc7d on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:39:59.887564 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Attempting to bind port 4f835a90-3c22-4814-8461-fb62812ddc7d by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:39:59.887948 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Attempting to bind port 4f835a90-3c22-4814-8461-fb62812ddc7d on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:39:59.902975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Pushing event updated for resources: {'Port': ['ID=4f835a90-3c22-4814-8461-fb62812ddc7d,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:39:59.913747 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 39, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:39:59.914204 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:39:59.914614 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.915089 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:39:59.915580 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Bound port: 4f835a90-3c22-4814-8461-fb62812ddc7d, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:39:59.917061 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:39:59.950232 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:39:59.951896 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:39:59.982733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-9f12f485-a7cf-4104-ac56-309f57042402 None None] Provisioning for port 71d9316f-ff03-4b95-bed2-2b2b160077db completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:00.004272 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.016966 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 71d9316f-ff03-4b95-bed2-2b2b160077db up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:00.052435 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:00.084243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Allocated IP 172.20.0.1 (db198222-1495-44ec-99cd-cc38de1c71df/eae8c611-60f5-420f-b883-17fbae330f18/2bf9f916-b14b-404f-af5d-32a215af7bab) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:00.199241 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a0c7bf9d-4305-4431-8293-4613cf11af3f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.321206 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] For port 4f835a90-3c22-4814-8461-fb62812ddc7d, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:00.325588 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:00.334899 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:00.341898 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] For port 4f835a90-3c22-4814-8461-fb62812ddc7d, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4f835a90-3c22-4814-8461-fb62812ddc7d,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:00.343203 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.381433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.392887 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:00.451433 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:00.461089 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:00.461703 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:00.471041 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 71d9316f-ff03-4b95-bed2-2b2b160077db completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:00.549648 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 71d9316f-ff03-4b95-bed2-2b2b160077db triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:00.550563 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.572194 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.674937 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:00.676252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:00.783582 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-18309786-41ff-4060-9cda-541831f0090d req-22166695-81c8-419c-a362-0e0ff67c77f0 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.1273806 May 25 15:40:00.814782 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39592) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:00.820423 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.825597 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1613640397', 'description': 'tempest-description--1406630675'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:00.833153 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:00.841072 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:00.842498 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:00.845744 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:00.846259 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eadcc8ba-4f62-4dc2-83f7-da8f9bf1c6e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:00.852192 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:00.866580 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:00.902220 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:00.912980 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:00.920866 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:00.927159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:00.947557 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:01.022970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Pushing event updated for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:01.034718 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:01.049477 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Network db198222-1495-44ec-99cd-cc38de1c71df is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:01.061002 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:01.063192 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98462) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:40:01.068120 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:01.068696 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.097365 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.102297 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.109863 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:01.195874 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Pushing event updated for resources: {'Port': ['ID=4f835a90-3c22-4814-8461-fb62812ddc7d,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:01.220215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cd97f1d8-9ac1-485f-9c3d-f94469df3e03,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:01.246930 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.854s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:01.248326 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:01.250815 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.257670 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.4418030 May 25 15:40:01.260778 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39606) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:01.266282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group_rule': {'security_group_id': 'cd97f1d8-9ac1-485f-9c3d-f94469df3e03', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:01.280097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:01.291101 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:01.295035 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:01.309162 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:01.367390 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.421794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.471465 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:39:58Z', 'revision_number': 2, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:01.487289 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:01.488635 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Updating router 927291b5-83b6-4e30-b11f-71ca95ddef81 port 457c32e2-b449-47fd-84fd-f6192b685bb2 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:01.570347 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.576750 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.578706 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:01.639236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 71d9316f-ff03-4b95-bed2-2b2b160077db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=71d9316f-ff03-4b95-bed2-2b2b160077db,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:01.646083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.647535 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.651561 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.652941 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3908496 May 25 15:40:01.654904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9332cc6f-e48c-47e3-885f-c9c5ab8c5c26,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:01.660341 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39628) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:01.674298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group_rule': {'security_group_id': 'cd97f1d8-9ac1-485f-9c3d-f94469df3e03', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:01.688900 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:01.697347 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:01.701691 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:01.709355 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:01.716721 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:01.734629 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:01.807956 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.842076 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:01.971095 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.973797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=71d9316f-ff03-4b95-bed2-2b2b160077db,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:01.983062 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:01.986011 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:02.001295 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-b0999956-71e6-4f8f-8b81-1586831107b5 None None] Provisioning complete for port 71d9316f-ff03-4b95-bed2-2b2b160077db triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:02.001680 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b0999956-71e6-4f8f-8b81-1586831107b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.032907 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:02.064054 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d4d41fc-d9b8-4402-80c1-a923cbf79037,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:02.073722 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:02.092555 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.095059 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.102776 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4412274 May 25 15:40:02.107270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39648) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:02.108281 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.405s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:02.118363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.118363 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 8.2476349 May 25 15:40:02.120934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:02.126058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39652) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:02.141411 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:02.209530 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-957df464-f842-497d-9289-2c55a494748b req-d339e0f1-b183-438a-b68a-68280231acb0 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.0990236 May 25 15:40:02.210173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.70', 61822) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:02.237463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:02.277701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:39:54Z', 'revision_number': 3, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:02.294573 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:02.294802 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:floatingip and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:02.294893 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:39:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:02.316420 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:02.333301 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:02.424551 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1738476-0eb3-4a3c-8450-f8686e767edb None None] The sync data for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi is: [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:39:54Z', 'revision_number': 3, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:00Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:02.494195 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.520949 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Transition to ACTIVE for port object 457c32e2-b449-47fd-84fd-f6192b685bb2 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:02.540807 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.543530 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.547895 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:02.567029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-5bbd907a-bcbd-4dbf-b8c7-067fb0e17d9b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:02.569244 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-5bbd907a-bcbd-4dbf-b8c7-067fb0e17d9b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.70 "GET /v2.0/networks?id=d995c251-7c0b-4025-9654-f6a6946e8b02 HTTP/1.1" status: 200 len: 812 time: 0.3580568 May 25 15:40:02.626598 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:02.627503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:02.640200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39668) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:02.667040 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Request body: {'port': {'device_id': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02', 'admin_state_up': True, 'tenant_id': '6defbd5b403b44ac8c53cbf324a7f8c9'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:03.071154 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d622d51-b31e-4174-86a7-f3e7ae100627 None None] Pushing event updated for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:03.154264 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-3d622d51-b31e-4174-86a7-f3e7ae100627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.606s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:03.180630 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-566017dc-bf04-4c1d-8ab8-63e137156377 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.182274 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.228930 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Attempting to bind port 457c32e2-b449-47fd-84fd-f6192b685bb2 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:03.229601 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Attempting to bind port 457c32e2-b449-47fd-84fd-f6192b685bb2 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:03.230146 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Attempting to bind port 457c32e2-b449-47fd-84fd-f6192b685bb2 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:03.242728 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:03.243128 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Checking segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:03.243512 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.248450 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Bound using segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:03.252453 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Bound port: 457c32e2-b449-47fd-84fd-f6192b685bb2, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:03.253086 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.289976 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:03.316877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:03.334450 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Usage tracker for resource:port and tenant:6defbd5b403b44ac8c53cbf324a7f8c9 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:03.349769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:03.373624 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:03.421230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Made reservation on behalf of 6defbd5b403b44ac8c53cbf324a7f8c9 for: {'port': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:03.439663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.549008 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] For port 457c32e2-b449-47fd-84fd-f6192b685bb2, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:03.556273 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] For port 457c32e2-b449-47fd-84fd-f6192b685bb2, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=457c32e2-b449-47fd-84fd-f6192b685bb2,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:03.566361 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.577305 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:03.606655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.711155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.735714 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:03.752618 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:03.774315 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:03.775169 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:03.984350 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Allocated IP 172.20.0.14 (d995c251-7c0b-4025-9654-f6a6946e8b02/42c665bd-6d57-4ffa-8c85-4ad61909dc6f/6f230de1-4bde-4abc-ac21-bfe2eddf6700) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:04.058073 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d622d51-b31e-4174-86a7-f3e7ae100627 None None] Pushing event updated for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=4']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:04.083124 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-3d622d51-b31e-4174-86a7-f3e7ae100627 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.502s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:04.146597 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.368650 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:04.504283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4f835a90-3c22-4814-8461-fb62812ddc7d up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:04.576364 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Pushing event updated for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:04.583708 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.588850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.836s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:04.663786 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.700238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:39:58Z', 'revision_number': 3, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:39:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:04.710369 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:04.724665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Updating router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:04.733715 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1f274839-0534-4903-ad72-0b5bc239aa9a req-09287912-a5dd-4c81-bfec-bd4e9e68055a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.3993697 May 25 15:40:04.748007 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.762807 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:04.779967 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Usage tracker for resource:security_group_rule and tenant:17a4a908d631411a820b50ed28581233 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:04.802462 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:04.825169 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:04.827197 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 4f835a90-3c22-4814-8461-fb62812ddc7d completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:04.857837 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 4f835a90-3c22-4814-8461-fb62812ddc7d triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:04.858506 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:04.931311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39742) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:04.963502 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Network db198222-1495-44ec-99cd-cc38de1c71df is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:04.985421 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:05.008562 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.017626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.058462 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:05.214942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Network d995c251-7c0b-4025-9654-f6a6946e8b02 is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:05.254935 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:05.257828 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Pushing event updated for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:05.278471 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:05.284492 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:05.286715 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.321356 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:40:05.360012 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.391032 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:05.396327 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.425230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.426310 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:05.439478 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Usage tracker for resource:security_group_rule and tenant:8e33d2545bf5442dab6c914bb904eca9 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:05.458847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:05.468209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-710189c2-b4a6-47cb-b3fd-aae046e6ad3d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:05.506863 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:03Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:05.508822 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8461061 May 25 15:40:05.521353 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:05.522490 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faaa8eb0-da44-4f11-af29-40235940fbdf None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:03Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:05.612114 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=06f60207-a92e-4faa-be00-a51512f49db0,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:05.642047 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=17a4a908d631411a820b50ed28581233&name=default HTTP/1.1" status: 200 len: 2975 time: 3.0005786 May 25 15:40:05.643233 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:05.645146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39760) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:05.899701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.926870 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.931590 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:05.970538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Allocated IP 172.27.0.200 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/9882a674-5864-4482-9c88-be96a363ceff) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:05.985399 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39772) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:06.001572 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 4f835a90-3c22-4814-8461-fb62812ddc7d, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4f835a90-3c22-4814-8461-fb62812ddc7d,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:06.021363 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.023846 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 71d9316f-ff03-4b95-bed2-2b2b160077db up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:06.088337 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.104744 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 39780) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:06.105220 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:06.114829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.115372 dv-cinder-791239-3-iscsi neutron-server[98462]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 25 15:40:06.152047 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.178870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:06.314717 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=8e33d2545bf5442dab6c914bb904eca9&name=default HTTP/1.1" status: 200 len: 2975 time: 1.3753190 May 25 15:40:06.317623 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39786) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:06.322723 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=4f835a90-3c22-4814-8461-fb62812ddc7d,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:06.329413 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec07b38b-8019-4d19-8b4d-4e35b7a64b0c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:06.335589 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:06.348096 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 71d9316f-ff03-4b95-bed2-2b2b160077db triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:06.349303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.356267 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Router 11ba60b2-4c9b-4c79-921e-91355709c4b2 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:40:06.362992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:06.396561 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.424036 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.438969 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:06.484778 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06f60207-a92e-4faa-be00-a51512f49db0,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:06.497003 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:06.545639 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.547484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.548650 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/06f60207-a92e-4faa-be00-a51512f49db0 HTTP/1.1" status: 204 len: 168 time: 0.9028151 May 25 15:40:06.563350 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.596719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.739611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.745053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:06.774564 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec07b38b-8019-4d19-8b4d-4e35b7a64b0c,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:06.784037 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:06.816505 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:06.833850 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/ec07b38b-8019-4d19-8b4d-4e35b7a64b0c HTTP/1.1" status: 204 len: 168 time: 0.5022364 May 25 15:40:06.882084 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4f835a90-3c22-4814-8461-fb62812ddc7d up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:06.949116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:07.005655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Usage tracker for resource:security_group_rule and tenant:4628f773ea5b4ce3ac4954d17c2b6278 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:07.053120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 4f835a90-3c22-4814-8461-fb62812ddc7d triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:07.053663 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.189810 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:07.222616 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39802) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:07.253013 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28d36eb-bc20-4333-9939-af8879d2f1a4 req-ac449b81-5b9a-4eec-8eb2-1958ca37074d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:07.255228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e28d36eb-bc20-4333-9939-af8879d2f1a4 req-ac449b81-5b9a-4eec-8eb2-1958ca37074d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 932 time: 1.1465821 May 25 15:40:07.275325 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.284842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:07.296070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.310349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:07.325672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Usage tracker for resource:security_group_rule and tenant:6ef9d2df83574bcd9547303f3ce58475 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:07.334104 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:07.342892 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 457c32e2-b449-47fd-84fd-f6192b685bb2 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:07.355054 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:07.490864 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:07.502765 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Sync routers for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:07.526011 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 457c32e2-b449-47fd-84fd-f6192b685bb2 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:07.532909 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:07.533866 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 457c32e2-b449-47fd-84fd-f6192b685bb2 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:07.535084 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.538035 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:07.567154 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e28d36eb-bc20-4333-9939-af8879d2f1a4 req-d6d4222d-94d0-4d7a-ad6c-16b71f719155 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2768052 May 25 15:40:07.667370 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.669600 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] 10.222.0.36 "PUT /v2.0/routers/11ba60b2-4c9b-4c79-921e-91355709c4b2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.4603679 May 25 15:40:07.671523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Allocated IP 172.20.0.1 (76bea034-0890-4bf6-b793-280aaec1a32c/2ce66291-0ef8-4b15-9e67-ba32027661fc/e92dc1c3-6a99-4b16-85a6-e348d26267f4) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:07.693356 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-358d0a5d-9042-43d2-80b3-f025885901dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:07.763440 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.795560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:07.829429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:07.989726 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.013085 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:08.013747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d260429-e01c-49de-b619-328100061761,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.029899 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.057304 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:08.073641 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:08.111256 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=6ef9d2df83574bcd9547303f3ce58475&name=default HTTP/1.1" status: 200 len: 2978 time: 0.8866227 May 25 15:40:08.114820 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39830) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:08.167221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.193258 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-a1b541c1-7b40-4ffb-a3e6-ff977e1245d4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98463) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:40:08.197047 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-a1b541c1-7b40-4ffb-a3e6-ff977e1245d4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0130813 May 25 15:40:08.281958 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Transition to ACTIVE for port object 7de68007-656f-4ebe-b48c-f94f0b3d44e1 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:08.301477 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.324432 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:08.361612 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.367318 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.391790 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.449695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.457454 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=9882a674-5864-4482-9c88-be96a363ceff,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.460478 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.461587 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.768s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.477860 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.484966 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-098a48af-2a7e-462f-bb8a-5a51ae1f3c8c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.506459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d260429-e01c-49de-b619-328100061761,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.509617 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.512806 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.522954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.524476 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/8d260429-e01c-49de-b619-328100061761 HTTP/1.1" status: 204 len: 168 time: 0.4085872 May 25 15:40:08.603370 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Transition to ACTIVE for port object e92dc1c3-6a99-4b16-85a6-e348d26267f4 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:08.695395 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.731753 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5a001f7-084e-427e-8ef4-7daf1d10aa65,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.745547 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.761267 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=4628f773ea5b4ce3ac4954d17c2b6278&name=default HTTP/1.1" status: 200 len: 2978 time: 2.7731459 May 25 15:40:08.761635 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Pushing event updated for resources: {'Port': ['ID=7de68007-656f-4ebe-b48c-f94f0b3d44e1,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.763811 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39852) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:08.801053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.410s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.840894 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.878287 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.890123 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Attempting to bind port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:08.890559 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Attempting to bind port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:08.890942 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Attempting to bind port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:08.939811 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:08.942807 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.945645 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:08.946378 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.946986 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:08.947699 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Bound port: 7de68007-656f-4ebe-b48c-f94f0b3d44e1, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:08.949350 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:08.949992 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.964145 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5a001f7-084e-427e-8ef4-7daf1d10aa65,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:08.967747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:08.970216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:08.974588 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/e5a001f7-084e-427e-8ef4-7daf1d10aa65 HTTP/1.1" status: 204 len: 168 time: 0.2066240 May 25 15:40:09.040703 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Request body: {'port': {'device_id': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:09.092792 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 457c32e2-b449-47fd-84fd-f6192b685bb2, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=457c32e2-b449-47fd-84fd-f6192b685bb2,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:09.115641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.127921 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:09.178534 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.359057 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] For port 7de68007-656f-4ebe-b48c-f94f0b3d44e1, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:09.363411 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.370858 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] For port 7de68007-656f-4ebe-b48c-f94f0b3d44e1, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=7de68007-656f-4ebe-b48c-f94f0b3d44e1,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:09.386975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.433310 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:09.443052 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.315s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:09.446919 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bc0c489e-ea1b-4434-a25b-b4045dc855c8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.044s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:09.481103 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.499489 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:40:01Z', 'revision_number': 4, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '2bf9f916-b14b-404f-af5d-32a215af7bab', 'name': '', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'mac_address': 'fa:16:3e:8d:68:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:59Z', 'updated_at': '2021-05-25T15:40:02Z', 'revision_number': 2, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'subnets': [{'id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:09.517073 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Checking router: 11ba60b2-4c9b-4c79-921e-91355709c4b2 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:09.517618 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Updating router 11ba60b2-4c9b-4c79-921e-91355709c4b2 port 2bf9f916-b14b-404f-af5d-32a215af7bab binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:09.542322 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.593482 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:09.608591 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:09.616724 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:09.661151 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.778878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Network 76bea034-0890-4bf6-b793-280aaec1a32c is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:09.790720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:09.806116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:09.811831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:09.850138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd95699-0b51-4ea3-b880-a301f14326de req-8b13df3a-1357-4611-ba93-4a2ba8d8beb2 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:09.873309 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8fd95699-0b51-4ea3-b880-a301f14326de req-8b13df3a-1357-4611-ba93-4a2ba8d8beb2 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 932 time: 1.0815661 May 25 15:40:09.883976 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Pushing event updated for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:09.891626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Pushing event updated for resources: {'Port': ['ID=7de68007-656f-4ebe-b48c-f94f0b3d44e1,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:09.904026 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.457s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:09.921720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.328s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:10.221642 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-356c0dbf-e45b-440a-970a-d48fc32e413f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:10.223027 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-356c0dbf-e45b-440a-970a-d48fc32e413f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:10.261682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:10.287649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-356c0dbf-e45b-440a-970a-d48fc32e413f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:10.296260 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-356c0dbf-e45b-440a-970a-d48fc32e413f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 819 time: 0.9786682 May 25 15:40:10.355280 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8fd95699-0b51-4ea3-b880-a301f14326de req-f663f096-e10d-4e1a-aa10-b9e853c44e8c tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4749293 May 25 15:40:10.361558 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.db.resource_extend [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:40:10.405455 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.420963 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.449727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:10.508621 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-880431c9-6c4c-43c1-bbb2-a37e713e7b00 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/quotas/0a695c168ea64d4f96c9e8751a6875ca HTTP/1.1" status: 200 len: 375 time: 0.2097721 May 25 15:40:10.570106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=9882a674-5864-4482-9c88-be96a363ceff,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:10.580642 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:10.585918 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.602689 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.613282 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Transition to ACTIVE for port object 2bf9f916-b14b-404f-af5d-32a215af7bab will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:10.630837 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.637442 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-8659c56e-ee1f-49b1-9947-35e146bf8664 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:10.674314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.691893 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 8.5714762 May 25 15:40:10.844664 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.870759 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0009906a-66e2-44af-b436-97df6d920f59 None None] Provisioning for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:10.885702 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0009906a-66e2-44af-b436-97df6d920f59 None None] Provisioning complete for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:10.886346 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0009906a-66e2-44af-b436-97df6d920f59 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:10.905154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.006034 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-131f124f-4448-4c97-b86a-317467a050cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4965301 May 25 15:40:11.068007 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-0009906a-66e2-44af-b436-97df6d920f59 None None] Port e92dc1c3-6a99-4b16-85a6-e348d26267f4 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:11.151504 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a088a14-95ee-45cc-b6df-1a842d3d75d6 None None] Pushing event updated for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:11.242573 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-1a088a14-95ee-45cc-b6df-1a842d3d75d6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.605s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:11.301230 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:39:58Z', 'revision_number': 3, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:11.310476 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a7b812a-7106-42f1-9faf-13df965785f9 None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:39:58Z', 'revision_number': 3, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:09Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:11.367628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.375050 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Attempting to bind port 2bf9f916-b14b-404f-af5d-32a215af7bab on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:11.377817 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Attempting to bind port 2bf9f916-b14b-404f-af5d-32a215af7bab by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:11.379037 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Attempting to bind port 2bf9f916-b14b-404f-af5d-32a215af7bab on network db198222-1495-44ec-99cd-cc38de1c71df {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:11.379142 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.386886 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 457c32e2-b449-47fd-84fd-f6192b685bb2 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:11.394382 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.410418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:11.426636 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:11.431693 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Checking segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:11.435143 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.439378 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Bound using segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:11.439597 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Bound port: 2bf9f916-b14b-404f-af5d-32a215af7bab, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:11.445307 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.555566 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6f230de1-4bde-4abc-ac21-bfe2eddf6700 {{(pid=98463) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:11.603137 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.681550 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 457c32e2-b449-47fd-84fd-f6192b685bb2 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:11.682306 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.757689 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] For port 2bf9f916-b14b-404f-af5d-32a215af7bab, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:11.761043 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Transition to ACTIVE for port object 6f230de1-4bde-4abc-ac21-bfe2eddf6700 will not be triggered until provisioned by entity L2. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:11.765419 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] For port 2bf9f916-b14b-404f-af5d-32a215af7bab, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=2bf9f916-b14b-404f-af5d-32a215af7bab,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:11.774515 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.796147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:11.798433 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:11.804888 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-abe58dab-2465-4e16-92e0-d1d602ab8848 service neutron] 10.222.0.36 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7797551 May 25 15:40:11.931525 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8cd81ab6-dc0e-4fed-947f-e94180e8e5a6 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:11.996963 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Pushing event updated for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:12.034028 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.623s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:12.054490 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Network 76bea034-0890-4bf6-b793-280aaec1a32c is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:12.063047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:12.091656 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:12.092085 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:12.435143 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 39950) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:12.650046 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a6f9f0ee-1e78-47b1-8468-7649e1b715d9 None None] Provisioning complete for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:12.653621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a6f9f0ee-1e78-47b1-8468-7649e1b715d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:12.731668 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:12.770744 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-3fc8a145-e2b9-4f7d-8310-e981ee0e94dc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-securitygroup--1613640397&fields=id&tenant_id=42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 267 time: 0.9013951 May 25 15:40:12.774931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:40:12.830974 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-a6f9f0ee-1e78-47b1-8468-7649e1b715d9 None None] Port e92dc1c3-6a99-4b16-85a6-e348d26267f4 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:12.926390 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Pushing event updated for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:12.932318 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a088a14-95ee-45cc-b6df-1a842d3d75d6 None None] Pushing event updated for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=4']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:12.936959 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.005s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:13.009870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Attempting to bind port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:13.010481 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Attempting to bind port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'feccb394-ccb2-48ac-98c1-f206da890375', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02'}] {{(pid=98463) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:13.013384 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Attempting to bind port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 on network d995c251-7c0b-4025-9654-f6a6946e8b02 {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:13.058914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 on network d995c251-7c0b-4025-9654-f6a6946e8b02 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:40:13.066951 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Attempting to bind port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 on network d995c251-7c0b-4025-9654-f6a6946e8b02 {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:13.125373 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-1a088a14-95ee-45cc-b6df-1a842d3d75d6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.327s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:13.191778 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:13.199356 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Checking segment: {'id': 'feccb394-ccb2-48ac-98c1-f206da890375', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:13.204555 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Bound using segment: {'id': 'feccb394-ccb2-48ac-98c1-f206da890375', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02'} {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:13.205181 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Bound port: 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'feccb394-ccb2-48ac-98c1-f206da890375', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 353, 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02'}}] {{(pid=98463) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:13.205560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:13.281047 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1717674821-network', 'tenant_id': '1cf5885420064bd1abad4e2199a3bb4f'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:13.325137 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-194bd044-e096-496f-a4c6-7e3ef00cfb39 service neutron] 10.222.0.36 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.4836726 May 25 15:40:13.338866 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:13.459830 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 7de68007-656f-4ebe-b48c-f94f0b3d44e1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:13.487589 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Usage tracker for resource:network and tenant:1cf5885420064bd1abad4e2199a3bb4f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:13.541580 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:13.569628 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:13.667110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Made reservation on behalf of 1cf5885420064bd1abad4e2199a3bb4f for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:13.695706 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:13.750285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:13.796658 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:13.823428 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:13.824294 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:13.825314 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, cleared binding levels {{(pid=98463) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:13.866215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:13.894843 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Usage tracker for resource:security_group_rule and tenant:1cf5885420064bd1abad4e2199a3bb4f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:13.900237 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700,segment=NetworkSegment(feccb394-ccb2-48ac-98c1-f206da890375),segment_id=feccb394-ccb2-48ac-98c1-f206da890375)] {{(pid=98463) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:13.901614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:13.909208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:13.914930 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:13.921933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:13.935357 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] 10.222.0.36 "PUT /v2.0/routers/033b53ca-9c17-4a0e-bdce-e24dc83318d6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 11.8041542 May 25 15:40:13.955151 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:14.058214 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-419c3821-4037-47e3-becb-5a1b31b0edae tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:14.060683 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-419c3821-4037-47e3-becb-5a1b31b0edae tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 811 time: 1.2848532 May 25 15:40:14.078799 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:40:01Z', 'revision_number': 4, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '2bf9f916-b14b-404f-af5d-32a215af7bab', 'name': '', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'mac_address': 'fa:16:3e:8d:68:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:59Z', 'updated_at': '2021-05-25T15:40:11Z', 'revision_number': 4, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'subnets': [{'id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:14.086466 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-e6145d96-a91a-4809-be24-8a75d51a7f72 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/quotas/42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 375 time: 0.0159001 May 25 15:40:14.104405 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00869a60-2aad-4d96-b682-30f6a33d8a14 None None] The sync data for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi is: [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:40:01Z', 'revision_number': 4, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '2bf9f916-b14b-404f-af5d-32a215af7bab', 'name': '', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'mac_address': 'fa:16:3e:8d:68:07', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:59Z', 'updated_at': '2021-05-25T15:40:11Z', 'revision_number': 4, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'subnets': [{'id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:14.452729 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:14.541059 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 7de68007-656f-4ebe-b48c-f94f0b3d44e1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=7de68007-656f-4ebe-b48c-f94f0b3d44e1,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:14.553130 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:14.555120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:14.566865 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-c79e69de-9c11-494c-946e-82f1bb614f34 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.4737937 May 25 15:40:14.663047 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:14.663665 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:14.665144 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] 10.222.0.70 "PUT /v2.0/ports/6f230de1-4bde-4abc-ac21-bfe2eddf6700 HTTP/1.1" status: 200 len: 1094 time: 6.0895953 May 25 15:40:14.668243 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:14.850275 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=7de68007-656f-4ebe-b48c-f94f0b3d44e1,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:14.861278 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:14.967408 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:14.994622 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:14.996303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:15.029245 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:15.064973 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Pushing event updated for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=3']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:15.108367 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.157s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:15.123776 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:15.197136 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 356} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:40:15.200526 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-72fe986d-7325-4582-ab6f-98e8cc1fba00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:15.417742 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:15.417742 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Added segment 546a7fff-24be-4e37-b415-b3f40224f52e of type vlan for network eb42d8f5-757c-4552-8e90-8f6270413f1c May 25 15:40:15.447823 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4573a3b4-0aa7-46fe-a3a1-95afa7b29b12,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:15.464168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:15.504333 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40064) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:15.515313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-67052046-4809-400a-af95-4ed5fddd883d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:15.516290 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-67052046-4809-400a-af95-4ed5fddd883d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Synchronizing usage tracker for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:15.609023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-815df987-e78d-4add-8a92-162b829ef1d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:15.626263 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-815df987-e78d-4add-8a92-162b829ef1d1 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6defbd5b403b44ac8c53cbf324a7f8c9&device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 1097 time: 0.7725675 May 25 15:40:15.661261 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:15.694094 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:15.742667 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-67052046-4809-400a-af95-4ed5fddd883d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Unset dirty status for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:15.752781 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-67052046-4809-400a-af95-4ed5fddd883d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 944 time: 1.3149912 May 25 15:40:15.893156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-84564ede-7015-44e5-9478-2cb9e95ce138 service neutron] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98462) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:40:15.895585 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-84564ede-7015-44e5-9478-2cb9e95ce138 service neutron] 10.222.0.36 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.4599159 May 25 15:40:15.967154 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:15.993892 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 7de68007-656f-4ebe-b48c-f94f0b3d44e1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:15.997930 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:15.998681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:16.006558 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-860a5daf-0325-4471-8a5f-97b421d36905 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700 HTTP/1.1" status: 200 len: 217 time: 0.2660007 May 25 15:40:16.014682 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a96e1bda-eca1-4b57-8cc6-54f8b4b79bfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:16.381911 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-f7e43ac5-570d-4f46-a243-14297b38bebd service neutron] 10.222.0.36 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4796469 May 25 15:40:16.390895 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:16.499314 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-e36baa3c-74c8-4623-93c0-0d2fc5ae9be4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Synchronizing usage tracker for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:16.514205 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 4.0759759 May 25 15:40:16.519611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40086) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:16.537442 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Request body: {'subnet': {'network_id': 'eb42d8f5-757c-4552-8e90-8f6270413f1c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1717674821-subnet', 'tenant_id': '1cf5885420064bd1abad4e2199a3bb4f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:16.540679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Pushing event updated for resources: {'Network': ['ID=eb42d8f5-757c-4552-8e90-8f6270413f1c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:16.548120 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-27ba1bea-2ee1-4e49-ba54-b6b7007aaf62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:16.551933 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-27ba1bea-2ee1-4e49-ba54-b6b7007aaf62 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=42c665bd-6d57-4ffa-8c85-4ad61909dc6f HTTP/1.1" status: 200 len: 852 time: 0.5084341 May 25 15:40:16.553103 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:16.558803 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.544s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:16.562298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Usage tracker for resource:subnet and tenant:1cf5885420064bd1abad4e2199a3bb4f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:16.566631 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:16.570500 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-e36baa3c-74c8-4623-93c0-0d2fc5ae9be4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Unset dirty status for tenant:6defbd5b403b44ac8c53cbf324a7f8c9 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:16.582751 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c055a93e-c05b-4d6e-a6a6-7c6a80d54452 req-e36baa3c-74c8-4623-93c0-0d2fc5ae9be4 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8275783 May 25 15:40:16.583559 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:16.592253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:16.602056 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:16.619221 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Made reservation on behalf of 1cf5885420064bd1abad4e2199a3bb4f for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:16.622666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:16.732089 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network eb42d8f5-757c-4552-8e90-8f6270413f1c details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:40:16.744104 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:16.762033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Usage tracker for resource:security_group_rule and tenant:1b51f192e78d44ee8f06113fc6c58daa is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:16.771632 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:16.797691 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:16.839888 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-34bd2dc3-6eb5-4607-b74f-230d55221103 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d995c251-7c0b-4025-9654-f6a6946e8b02&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1859367 May 25 15:40:16.902661 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-d148a870-9dc2-4997-801b-4bad1a2521e4 service neutron] 10.222.0.36 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4824829 May 25 15:40:17.030968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.036754 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.067378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c17beee8-4745-4e02-a920-232e4df21947 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:17.107097 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9bb606a1-4c6b-41a5-81fd-db6e36cca856 req-05ff77d0-b725-413c-bf97-bd2cc1ae8d5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 210 time: 0.0945363 May 25 15:40:17.173970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=1b51f192e78d44ee8f06113fc6c58daa&name=default HTTP/1.1" status: 200 len: 2979 time: 1.6671829 May 25 15:40:17.175993 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40096) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:17.267669 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81357da1-7e8d-4d2a-b6ba-a17d30831757,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:17.272924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:17.329666 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:11Z', 'revision_number': 2, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:17.333494 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 2bf9f916-b14b-404f-af5d-32a215af7bab up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:17.435054 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.445168 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:17.450755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Updating router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 port e92dc1c3-6a99-4b16-85a6-e348d26267f4 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:17.502748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.630963 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.700152 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.723420 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:17.747774 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700', 'status': 'completed', 'code': 200} May 25 15:40:17.756989 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81357da1-7e8d-4d2a-b6ba-a17d30831757,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:17.771647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:17.777596 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:17.785992 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/81357da1-7e8d-4d2a-b6ba-a17d30831757 HTTP/1.1" status: 204 len: 168 time: 0.6005056 May 25 15:40:17.794489 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-491f1f4e-6057-46e4-bb97-eb06242e56f8 service neutron] 10.222.0.70 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6782818 May 25 15:40:17.969415 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-deec37c6-3fcb-4ea8-9b34-1b9ec54f9315 req-962af079-2b9e-459c-88de-1a5cc14787b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 210 time: 0.1732028 May 25 15:40:18.160598 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.70', 61846) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:18.528888 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eebfd0e-3c63-454c-87fa-e520d6465d7f req-1a34d591-2317-408a-adda-4990bfef8563 service neutron] 10.222.0.70 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6825948 May 25 15:40:18.529440 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 2bf9f916-b14b-404f-af5d-32a215af7bab completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:18.621498 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 2bf9f916-b14b-404f-af5d-32a215af7bab triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:18.622872 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:18.627478 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40166) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:18.657789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1952490476', 'description': 'tempest-description--732295278'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:18.690130 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:18.707276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:18.722482 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:18.748674 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:18.756713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:18.764518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40170) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:18.770053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:18.801630 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:18.824608 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-721d7102-80bb-4177-a774-f5e556980a64 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:18.826543 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-721d7102-80bb-4177-a774-f5e556980a64 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 819 time: 0.6621053 May 25 15:40:18.849298 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:18.878493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-936b4cbf-a9da-45df-9d81-80ae107786b5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:18.880064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-936b4cbf-a9da-45df-9d81-80ae107786b5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 819 time: 0.5864191 May 25 15:40:18.881096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Usage tracker for resource:security_group_rule and tenant:62cddfb87c74423e8a3b806b836fc7fb is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:18.887881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:18.894786 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:18.917467 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-d9ca3189-4f25-4b05-8d7e-fdd95628a7c6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/quotas/0a695c168ea64d4f96c9e8751a6875ca HTTP/1.1" status: 200 len: 375 time: 0.0192609 May 25 15:40:18.919523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:18.942301 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.022863 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Checking segment: {'id': '546a7fff-24be-4e37-b415-b3f40224f52e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 356, 'network_id': 'eb42d8f5-757c-4552-8e90-8f6270413f1c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:19.023215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Network hostable DHCP agents. Network: eb42d8f5-757c-4552-8e90-8f6270413f1c, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:40:19.038190 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.041479 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 2bf9f916-b14b-404f-af5d-32a215af7bab, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=2bf9f916-b14b-404f-af5d-32a215af7bab,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:19.050130 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.053351 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.055321 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Pushing event updated for resources: {'Subnet': ['ID=abe3b1d4-9e67-4e40-82ea-45697c2f617d,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:19.058242 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.060850 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:19.066341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-121502e8-1d45-4df9-903b-b3aacac693f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:19.071763 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:19.076329 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:19.081805 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Network eb42d8f5-757c-4552-8e90-8f6270413f1c is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:40:19.087040 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Transition to ACTIVE for port object e92dc1c3-6a99-4b16-85a6-e348d26267f4 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:19.094537 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:19.099444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, eb42d8f5-757c-4552-8e90-8f6270413f1c) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:19.104672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:19.105281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.118978 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f37d69d-f59e-4224-bdc3-2473b28e17bb None None] Network eb42d8f5-757c-4552-8e90-8f6270413f1c requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:19.136178 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.138538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.144850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.153318 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 req-dec90caa-aa45-426a-a811-234ef7b86232 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:19.154896 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 req-dec90caa-aa45-426a-a811-234ef7b86232 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 944 time: 0.2238734 May 25 15:40:19.162929 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-036acc9b-f773-4e16-8c10-d535311e851f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.181392 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 2.6513076 May 25 15:40:19.195314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6ff312f-8ea5-4bab-8f17-4bab455ec19b,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:19.214192 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-121502e8-1d45-4df9-903b-b3aacac693f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:19.225047 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-121502e8-1d45-4df9-903b-b3aacac693f2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3065352 May 25 15:40:19.235235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.254619 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ec45b93-5f94-4ac5-af06-b3c7e85aeb00 req-305aa4ce-6861-46dd-ad98-f1a2711c6919 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0791612 May 25 15:40:19.274781 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=62cddfb87c74423e8a3b806b836fc7fb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5090950 May 25 15:40:19.279436 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40182) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:19.313250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:19.338252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.338822 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.193s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.355060 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.387439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.420680 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:19.440306 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-92dab6a0-2c66-4b51-8a24-2a35895a59e1 service neutron] 10.222.0.36 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2140639 May 25 15:40:19.475529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c337eddc-a70e-4a8c-8701-85a39104333d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:19.493682 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.521704 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Request body: {'port': {'device_id': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'admin_state_up': True, 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:19.550307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-42e0978a-3c14-4141-98c4-3929fa0098dd req-1ebd2adc-41ad-4d6b-a3d6-9473865aabc8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:19.606833 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.608831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.610160 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.9768400 May 25 15:40:19.612542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-42e0978a-3c14-4141-98c4-3929fa0098dd req-1ebd2adc-41ad-4d6b-a3d6-9473865aabc8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:19.621470 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-42e0978a-3c14-4141-98c4-3929fa0098dd req-1ebd2adc-41ad-4d6b-a3d6-9473865aabc8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 210 time: 0.1564353 May 25 15:40:19.629953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40190) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:19.664272 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Pushing event updated for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:19.673402 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.334s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:19.674243 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Attempting to bind port e92dc1c3-6a99-4b16-85a6-e348d26267f4 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:19.674799 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Attempting to bind port e92dc1c3-6a99-4b16-85a6-e348d26267f4 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:19.675297 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Attempting to bind port e92dc1c3-6a99-4b16-85a6-e348d26267f4 on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:19.703611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group_rule': {'security_group_id': 'c337eddc-a70e-4a8c-8701-85a39104333d', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:19.719663 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:19.720321 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Checking segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:19.720887 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.721413 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Bound using segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:19.722096 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Bound port: e92dc1c3-6a99-4b16-85a6-e348d26267f4, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:19.722614 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.726308 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:19.730765 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:19.739146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:19.754563 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:19.821344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.843935 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-6a2ef49d-d3f1-4ae0-8ab4-97514580d189 service neutron] 10.222.0.36 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3859129 May 25 15:40:19.852543 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:19.855250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a86ba5db-60eb-45bb-838b-2092f4120fc9 None None] Network eb42d8f5-757c-4552-8e90-8f6270413f1c requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:19.887658 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:19.912651 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Made reservation on behalf of 0a695c168ea64d4f96c9e8751a6875ca for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:19.918800 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:19.939498 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.005506 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.018990 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.021930 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-14a6563d-310e-470f-85ce-6575c953487e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.030905 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-0326b1a3-822a-456f-8bce-e131180ec768 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:20.032472 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-0326b1a3-822a-456f-8bce-e131180ec768 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6defbd5b403b44ac8c53cbf324a7f8c9&device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 1097 time: 0.4055429 May 25 15:40:20.142214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.144757 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5103972 May 25 15:40:20.152602 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40216) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:20.186992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f22644fc-4262-4c3a-bc23-37430352a33f,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:20.282916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group_rule': {'security_group_id': 'c337eddc-a70e-4a8c-8701-85a39104333d', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:20.291611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:20.291818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] For port e92dc1c3-6a99-4b16-85a6-e348d26267f4, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:20.298242 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:20.302396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:20.309386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:20.398542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.419794 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-14912f50-b9b1-4f55-aaba-c0f2f931465c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.397s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.449065 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] For port e92dc1c3-6a99-4b16-85a6-e348d26267f4, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e92dc1c3-6a99-4b16-85a6-e348d26267f4,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:20.461653 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.469517 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-cf6cd94c-48e6-41be-bef7-b32097b9c3f9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.501896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40232) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:20.502735 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.091s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:20.516032 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-32109711-10f1-4018-84d8-43303a42c7bf req-3be9da3f-8655-4520-b15a-ff1c6ab00121 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 210 time: 0.1698766 May 25 15:40:20.531091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2108646745-network', 'tenant_id': '7296eb2670794e5f804c74fd75621a37'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:20.543841 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6ff312f-8ea5-4bab-8f17-4bab455ec19b,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:20.545738 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.561330 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.569291 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:20.621751 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:20.622405 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:20.632467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.639893 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f6ff312f-8ea5-4bab-8f17-4bab455ec19b HTTP/1.1" status: 204 len: 168 time: 1.3565538 May 25 15:40:20.673217 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Usage tracker for resource:network and tenant:7296eb2670794e5f804c74fd75621a37 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:20.698020 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:20.700342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Pushing event updated for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:20.711005 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Allocated IP 172.20.0.6 (db198222-1495-44ec-99cd-cc38de1c71df/eae8c611-60f5-420f-b883-17fbae330f18/62bd6a93-b70f-4e83-a70a-9b823ecbd7dc) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:20.720501 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:20.791027 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.880159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:20.889325 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:20.915816 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d018506-7b79-4bd4-9408-7163baaefdc8 req-3bfa0dcf-b8e6-489a-a91e-145c31bfab2b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:20.921596 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8d018506-7b79-4bd4-9408-7163baaefdc8 req-3bfa0dcf-b8e6-489a-a91e-145c31bfab2b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 944 time: 0.3820379 May 25 15:40:20.923199 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.70', 61852) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:20.942972 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40254) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:21.027300 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:21.082926 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:21.208158 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0519ee5d-f375-4f77-baa6-50ee15ee8d9b req-f2314cae-27c0-4d7f-8645-56857fe41277 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 210 time: 0.3378277 May 25 15:40:21.208824 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Made reservation on behalf of 7296eb2670794e5f804c74fd75621a37 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:21.211147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.259206 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-ecef1032-3343-48e0-818a-973053bd9f22 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:21.260677 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-ecef1032-3343-48e0-818a-973053bd9f22 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 811 time: 0.3298044 May 25 15:40:21.262330 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9548d8c5-3474-4282-b344-a3c7ce1d793f,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:21.291101 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:21.291785 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.316949 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-97b3ddfe-a73c-41ab-be33-39743e70ef22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:21.318430 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-97b3ddfe-a73c-41ab-be33-39743e70ef22 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d995c251-7c0b-4025-9654-f6a6946e8b02 HTTP/1.1" status: 200 len: 913 time: 1.2404256 May 25 15:40:21.322790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.326964 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1703734 May 25 15:40:21.335993 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40272) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:21.344410 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:21.357096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:21.373057 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8d018506-7b79-4bd4-9408-7163baaefdc8 req-9dc04e6b-c9c7-4d6d-b68d-1602f0dd9cb3 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4387848 May 25 15:40:21.387734 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:21.414274 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:floatingip and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:21.420840 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-02134299-62c0-4a05-98e0-a571230ca292 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 380 time: 0.1104231 May 25 15:40:21.424069 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:21.450619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'port': {'device_id': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'admin_state_up': True, 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'security_groups': ['cd97f1d8-9ac1-485f-9c3d-f94469df3e03']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:21.467445 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:21.477376 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Usage tracker for resource:security_group_rule and tenant:7296eb2670794e5f804c74fd75621a37 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:21.497868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:21.500322 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 2bf9f916-b14b-404f-af5d-32a215af7bab up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:21.519188 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-cb3b739f-daa5-4a59-a978-1688ba8997b3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700 HTTP/1.1" status: 200 len: 217 time: 0.1846642 May 25 15:40:21.616401 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:21.654564 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.705313 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 2bf9f916-b14b-404f-af5d-32a215af7bab triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:21.705825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.744234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.747224 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-ec836a59-33ae-44f4-a3d3-3ac90a27615a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:21.748834 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-ec836a59-33ae-44f4-a3d3-3ac90a27615a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=42c665bd-6d57-4ffa-8c85-4ad61909dc6f HTTP/1.1" status: 200 len: 852 time: 0.2245281 May 25 15:40:21.754986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:21.784257 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:20Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:21.790814 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8fed5143-d01b-4c45-9a3e-2ee5c4119508 None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:20Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:21.838091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:21.880019 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-0d6ec7e6-e9dc-45bf-8701-d9f85566cffc service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d995c251-7c0b-4025-9654-f6a6946e8b02&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1183512 May 25 15:40:21.916246 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aed1a015-a671-45d3-93a8-b1bf91410620 req-0ef0bf77-a89d-4611-9c6f-e00a40f637dd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 210 time: 0.0804949 May 25 15:40:21.979196 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Pushing event updated for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:21.997039 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:21.999563 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Network db198222-1495-44ec-99cd-cc38de1c71df is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:22.066380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.124317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.70', 61856) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:22.131015 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.158133 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:22.160886 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:22.166752 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.167520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:22.168214 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.177691 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.202583 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:22.207709 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:22.215777 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Usage tracker for resource:security_group_rule and tenant:0dd51541c44f4b0cbd438bde9dcc98e6 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:22.227772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:22.265621 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:22.267743 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:22.305326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Made reservation on behalf of 42ea914db4fc4438a1d50bfff262a6e8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:22.310792 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.331527 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.8192110 May 25 15:40:22.395985 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7990e26a-5a2f-4e1e-b92b-ff3c94634b55,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:22.414607 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:22.447732 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.511957 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-29842e39-2a2f-40d7-94fc-bdd0072c74e4 service neutron] 10.222.0.70 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5945649 May 25 15:40:22.512766 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 368} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:40:22.533842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Request body: {'port': {'device_id': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:22.575528 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.666983 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-d4f62fba-a46b-4715-9874-38356abf01ee tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:22.668502 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-d4f62fba-a46b-4715-9874-38356abf01ee tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 819 time: 0.5432563 May 25 15:40:22.681239 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.681681 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Added segment f2ae6b83-19d7-48d9-bc95-813673a81ade of type vlan for network cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b May 25 15:40:22.703155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Request body: {'port': {'device_id': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'admin_state_up': True, 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:22.793237 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Allocated IP 172.20.0.9 (320ad3f5-0f83-444c-8df0-70303c7a4446/02ba8877-ef07-4ef0-b677-beca89c84dcb/cfbb7459-c8f7-4441-8886-be2a6b4ad1a7) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:22.825620 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:22.901542 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1ed89145-9d5d-4195-9c66-b8bf99559379 req-1b674447-a8df-44b4-ae6e-a99dc2fbfd87 service neutron] 10.222.0.70 "GET /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3721969 May 25 15:40:22.961178 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2097a48-c0b2-486a-97d3-430b43153147 req-987bfef6-0913-4874-8c00-4c311593cf78 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:22.971389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:22.973905 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a2097a48-c0b2-486a-97d3-430b43153147 req-987bfef6-0913-4874-8c00-4c311593cf78 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 944 time: 0.4509091 May 25 15:40:23.022180 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8ab17df9-9187-4256-b81f-c05ae71fcee8 req-accb7845-94ff-4cc4-be12-41120e48799f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 210 time: 0.5687511 May 25 15:40:23.024714 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.030517 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:23.031113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.064133 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:23.114250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:23.165802 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=0dd51541c44f4b0cbd438bde9dcc98e6&name=default HTTP/1.1" status: 200 len: 2979 time: 2.2002218 May 25 15:40:23.192112 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40338) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:23.223993 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6f230de1-4bde-4abc-ac21-bfe2eddf6700 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:40:23.232600 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e92dc1c3-6a99-4b16-85a6-e348d26267f4 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:23.244258 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Usage tracker for resource:port and tenant:0a695c168ea64d4f96c9e8751a6875ca is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:23.260970 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a2097a48-c0b2-486a-97d3-430b43153147 req-b61cd521-b20f-45a4-bf79-05b559f02fa0 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2786741 May 25 15:40:23.264683 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:23.300163 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a req-b27eec82-3b8e-4170-9f83-20c0af1894d1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:23.309853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:23.331905 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Pushing event updated for resources: {'Network': ['ID=cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:23.345201 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.349941 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 2.8300369 May 25 15:40:23.351976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40346) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:23.356706 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.364461 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Request body: {'subnet': {'network_id': 'cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2108646745-subnet', 'tenant_id': '7296eb2670794e5f804c74fd75621a37', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:23.366330 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:40:23.382420 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Made reservation on behalf of 0a695c168ea64d4f96c9e8751a6875ca for: {'port': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:23.393217 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.409135 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:23.434397 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Usage tracker for resource:subnet and tenant:7296eb2670794e5f804c74fd75621a37 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:23.439441 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:23.495912 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=feda9de5-f0a9-4543-b5d9-6ece7108aad3,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:23.496909 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:23.510536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.511689 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.519576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.548s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.536304 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.db.resource_extend [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] It took 0.14 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:40:23.537898 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Made reservation on behalf of 7296eb2670794e5f804c74fd75621a37 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:23.546625 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Notify callbacks [] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.598520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a req-b27eec82-3b8e-4170-9f83-20c0af1894d1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:23.599743 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-769e6ef3-3914-4e9d-aaf7-2c95f2a5a94a req-b27eec82-3b8e-4170-9f83-20c0af1894d1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 210 time: 0.3788688 May 25 15:40:23.640839 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.664275 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.683965 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:23.710208 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:23.710584 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.789218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Transition to ACTIVE for port object cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:23.802333 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Allocated IP 172.20.0.11 (db198222-1495-44ec-99cd-cc38de1c71df/eae8c611-60f5-420f-b883-17fbae330f18/58598550-b0ed-4b7c-a4d8-2e58f345261c) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:23.899158 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700,segment=NetworkSegment(feccb394-ccb2-48ac-98c1-f206da890375),segment_id=feccb394-ccb2-48ac-98c1-f206da890375)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:23.925658 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.935185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:23.936708 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Allocated IP 172.27.0.235 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/58f86c62-d993-4050-ac05-c997927db6dc) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:23.937427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '6f230de1-4bde-4abc-ac21-bfe2eddf6700', 'network_id': 'd995c251-7c0b-4025-9654-f6a6946e8b02', 'port_id': '6f230de1-4bde-4abc-ac21-bfe2eddf6700', 'mac_address': 'fa:16:3e:82:73:25', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 353, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '42c665bd-6d57-4ffa-8c85-4ad61909dc6f', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:40:23.945867 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e7f7d9e3-3a05-440c-b899-92cfadf7eb2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:23.969155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=feda9de5-f0a9-4543-b5d9-6ece7108aad3,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:23.979851 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:23.981196 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.037840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.062642 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port e92dc1c3-6a99-4b16-85a6-e348d26267f4, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e92dc1c3-6a99-4b16-85a6-e348d26267f4,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:24.065069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6f230de1-4bde-4abc-ac21-bfe2eddf6700 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:24.079615 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.083682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.130707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aeda681e-e531-40cd-89a7-54fa4bc0a1b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.154733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.155901 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/feda9de5-f0a9-4543-b5d9-6ece7108aad3 HTTP/1.1" status: 204 len: 168 time: 0.9079254 May 25 15:40:24.198233 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700,segment=NetworkSegment(feccb394-ccb2-48ac-98c1-f206da890375),segment_id=feccb394-ccb2-48ac-98c1-f206da890375)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:24.211526 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.225713 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:24.229452 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.230107 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.016s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.366400 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:24.373658 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.397339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:24.402464 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:24.413493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:24.427389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:24.430612 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.464305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:24.478438 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.347s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:24.509292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['6f230de1-4bde-4abc-ac21-bfe2eddf6700'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:40:24.636971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.662001 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.2178252 May 25 15:40:24.679055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Request body: {'port': {'device_id': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:24.703018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.743916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90e845f9-2062-48cf-bd5e-67c60655b33d req-b676dcbb-5af0-4c05-a073-28212b2d31f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:24.754475 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-90e845f9-2062-48cf-bd5e-67c60655b33d req-b676dcbb-5af0-4c05-a073-28212b2d31f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 931 time: 0.5220540 May 25 15:40:24.829653 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 req-09c9ba3a-b649-4f3c-b625-d2f84a0f5486 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:24.838706 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 req-09c9ba3a-b649-4f3c-b625-d2f84a0f5486 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 945 time: 0.3115323 May 25 15:40:24.850693 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-90e845f9-2062-48cf-bd5e-67c60655b33d req-810988df-f2bb-4d08-92ae-a4c492cee2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:24.854424 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.884178 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:24.892650 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-90e845f9-2062-48cf-bd5e-67c60655b33d req-810988df-f2bb-4d08-92ae-a4c492cee2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:24.906698 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-90e845f9-2062-48cf-bd5e-67c60655b33d req-810988df-f2bb-4d08-92ae-a4c492cee2e0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1452317 May 25 15:40:24.917709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:24.918096 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-7e23f63e-204a-4ee0-a464-8df7a63c397f None None] Provisioning for port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:24.932331 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-7e23f63e-204a-4ee0-a464-8df7a63c397f None None] Provisioning complete for port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:24.932984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7e23f63e-204a-4ee0-a464-8df7a63c397f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.052538 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e6731e1b-a83b-4c77-8d35-37eec655614d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:25.055352 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40398) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:25.064462 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-7e23f63e-204a-4ee0-a464-8df7a63c397f None None] Port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:25.108319 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.130879 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:25.142590 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:25.152713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.165489 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:25.184494 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bb76058-21a0-4a2e-84a4-9a4929987ea6 req-465d6439-39fc-4fd9-a16c-a2d25edbb2b2 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3446698 May 25 15:40:25.185953 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e92dc1c3-6a99-4b16-85a6-e348d26267f4 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:25.199975 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=58f86c62-d993-4050-ac05-c997927db6dc,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:25.254655 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Network db198222-1495-44ec-99cd-cc38de1c71df is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:25.257294 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Pushing event updated for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:25.260936 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.377s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:25.272472 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:25.279491 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:25.281821 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:25.287635 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:25.288812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.292917 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:25.297587 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e92dc1c3-6a99-4b16-85a6-e348d26267f4 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:25.298061 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.305471 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.310821 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Usage tracker for resource:security_group_rule and tenant:39f76e0d55114af582e01fa7137c2056 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:25.314666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-918e9764-2f1a-4a76-89ee-6f0109bdfebb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:25.320790 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:25.346127 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:25.365071 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.6813030 May 25 15:40:25.378777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40406) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:25.391067 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Request body: {'port': {'device_id': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:25.408570 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.455976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Pushing event updated for resources: {'Subnet': ['ID=4c10c6a2-0abc-488b-b045-b235d0aaf20c,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:25.468437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:25.492487 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Checking segment: {'id': 'f2ae6b83-19d7-48d9-bc95-813673a81ade', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 368, 'network_id': 'cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:25.492846 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Network hostable DHCP agents. Network: cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:40:25.535360 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-587c02e3-a412-421f-9371-48ab44cb6362 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:25.536080 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-587c02e3-a412-421f-9371-48ab44cb6362 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:25.586484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.611511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.620344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Network cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:40:25.625268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:25.627317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-587c02e3-a412-421f-9371-48ab44cb6362 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:25.629041 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-587c02e3-a412-421f-9371-48ab44cb6362 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 932 time: 0.4715030 May 25 15:40:25.639793 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Usage tracker for resource:security_group_rule and tenant:c662cb6de7fc41c98506e24e1311745a is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:25.644737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:25.659836 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:25.671242 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.676534 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.686311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:25.694824 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5358411c-0672-4af1-856c-75369c284634 None None] Network cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:25.698171 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:25.715015 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:25.715602 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.769043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Transition to ACTIVE for port object 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:25.776815 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-f08a5112-59de-4ed8-951b-aac5426aa79b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:25.780091 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d12d5fb0-898c-4e4e-86a9-34597a61c97c admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 2.4269946 May 25 15:40:25.801863 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:25.953953 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5665ed10-ec49-4391-924a-6c977868009f None None] Network cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:25.979807 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40416) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:26.028945 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.064622 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.076513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.088615 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.146354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Deleting subnet abe3b1d4-9e67-4e40-82ea-45697c2f617d {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:40:26.156349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.196438 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c662cb6de7fc41c98506e24e1311745a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8140547 May 25 15:40:26.205268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=480cfa10-83bf-4bcf-9123-1bcd232f4843,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.215249 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40422) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:26.217678 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.254211 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.274560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.318091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.340305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Pushing event updated for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.348538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.352955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.324s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.387448 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-f08a5112-59de-4ed8-951b-aac5426aa79b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:26.388697 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6829552a-03a0-4430-8dc3-0ff5a98bba4e req-f08a5112-59de-4ed8-951b-aac5426aa79b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7502680 May 25 15:40:26.397239 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.438202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:26.486727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.499530 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.502257 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Attempting to bind port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:26.502627 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Attempting to bind port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:26.503023 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Attempting to bind port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc on network db198222-1495-44ec-99cd-cc38de1c71df {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:26.507798 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=39f76e0d55114af582e01fa7137c2056&name=default HTTP/1.1" status: 200 len: 2979 time: 1.4462440 May 25 15:40:26.515336 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fad1192-a42f-44e3-b2b3-f78e6c70b852,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.519588 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40428) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:26.525203 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.539094 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.540619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc on network db198222-1495-44ec-99cd-cc38de1c71df not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:40:26.540939 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Attempting to bind port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc on network db198222-1495-44ec-99cd-cc38de1c71df {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:26.551554 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.554593 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 58598550-b0ed-4b7c-a4d8-2e58f345261c {{(pid=98463) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:26.555239 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Transition to ACTIVE for port object cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:26.557609 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-46d1eb8f-406c-4db4-9fec-2ced754fad6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.594149 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:26.594491 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Checking segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:26.595070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Bound using segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:26.595580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Bound port: 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:26.595944 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.606857 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.620774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.657355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 req-1e602c76-48b3-4190-9c8f-bd877dc08669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:26.658058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 req-1e602c76-48b3-4190-9c8f-bd877dc08669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:26.662380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.666515 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.693433 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Transition to ACTIVE for port object 58598550-b0ed-4b7c-a4d8-2e58f345261c will not be triggered until provisioned by entity L2. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:26.719409 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.749529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3fca0118-01cf-491d-ae14-d8efab28e088 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.816965 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=58f86c62-d993-4050-ac05-c997927db6dc,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.838618 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.842764 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.193s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:26.882674 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 req-1e602c76-48b3-4190-9c8f-bd877dc08669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:26.884109 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 req-1e602c76-48b3-4190-9c8f-bd877dc08669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 931 time: 0.8255622 May 25 15:40:26.937248 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Pushing event updated for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.973520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:26.975062 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.6360300 May 25 15:40:26.975173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:26.995901 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c751ee72-6c52-4150-9730-8ba80080c22e req-2c6de9b7-0625-4af9-bd46-5011b0a209b1 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:26.996317 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Pushing event updated for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:26.997826 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c751ee72-6c52-4150-9730-8ba80080c22e req-2c6de9b7-0625-4af9-bd46-5011b0a209b1 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 945 time: 0.4338839 May 25 15:40:27.005318 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.014776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.026211 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.029616 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bbe9f21b-e647-45fb-a32e-e45e5b0b3e79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.042345 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:27.046447 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Attempting to bind port 58598550-b0ed-4b7c-a4d8-2e58f345261c on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:27.046986 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Attempting to bind port 58598550-b0ed-4b7c-a4d8-2e58f345261c by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}] {{(pid=98463) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:27.047547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Attempting to bind port 58598550-b0ed-4b7c-a4d8-2e58f345261c on network db198222-1495-44ec-99cd-cc38de1c71df {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:27.054113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=480cfa10-83bf-4bcf-9123-1bcd232f4843,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.073995 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.076469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Port 58598550-b0ed-4b7c-a4d8-2e58f345261c on network db198222-1495-44ec-99cd-cc38de1c71df not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:40:27.076942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Attempting to bind port 58598550-b0ed-4b7c-a4d8-2e58f345261c on network db198222-1495-44ec-99cd-cc38de1c71df {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:27.083944 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b03346ab-f5ba-4b0f-ab35-5cd636fea2c2 req-0875111f-524e-42d6-8ac5-f5d0a718aac8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1559193 May 25 15:40:27.084556 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Attempting to bind port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:27.084890 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Attempting to bind port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:27.085221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Attempting to bind port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:27.086390 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.095222 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:27.095680 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Checking segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:27.096302 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Bound using segment: {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'} {{(pid=98463) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:27.097321 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.managers [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Bound port: 58598550-b0ed-4b7c-a4d8-2e58f345261c, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b90cd672-6077-4a06-b3ec-e05219e8e214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df'}}] {{(pid=98463) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:27.098003 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.099156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:27.103189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:40:27.103518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Attempting to bind port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:27.115078 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.118651 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-65bd7ebc-b069-489b-aa1f-89d93b60873d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.182815 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.183795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:27.184284 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Checking segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:27.184796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Bound using segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:27.185326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Bound port: cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:27.185752 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.189385 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=abe3b1d4-9e67-4e40-82ea-45697c2f617d,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.197843 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.198873 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.200031 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/480cfa10-83bf-4bcf-9123-1bcd232f4843 HTTP/1.1" status: 204 len: 168 time: 0.9838176 May 25 15:40:27.211142 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.236630 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.238313 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-76af8f89-4f0d-46c1-b229-3ce61e68da16 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/abe3b1d4-9e67-4e40-82ea-45697c2f617d HTTP/1.1" status: 204 len: 168 time: 1.2550733 May 25 15:40:27.251491 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40450) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:27.278806 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:27.279556 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.280570 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c751ee72-6c52-4150-9730-8ba80080c22e req-ce709041-746a-4c79-8bc4-8d77c8467dc0 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2353098 May 25 15:40:27.281152 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] 10.222.0.70 "PUT /v2.0/ports/62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 1093 time: 4.8301499 May 25 15:40:27.282296 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:27.397475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.411759 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, cleared binding levels {{(pid=98463) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:27.417715 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.432906 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98463) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:27.466172 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.470377 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-907cf370-3869-47bf-92ca-f80b9d146da3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-securitygroup--1952490476&fields=id&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 267 time: 0.1968932 May 25 15:40:27.482519 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Pushing event updated for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.489469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.490895 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.491989 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/5fad1192-a42f-44e3-b2b3-f78e6c70b852 HTTP/1.1" status: 204 len: 168 time: 0.9681828 May 25 15:40:27.493266 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f6a92f36-7eba-49df-8ef1-710eeaba7e5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.056s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.495085 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.534193 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fad1192-a42f-44e3-b2b3-f78e6c70b852,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.556137 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.623181 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:27.640825 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:27.657445 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.664722 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.677305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d6b8bb67-42d1-4357-9b2e-bb1e47d9cac7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:27.682111 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:27.682948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.684487 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] 10.222.0.70 "PUT /v2.0/ports/58598550-b0ed-4b7c-a4d8-2e58f345261c HTTP/1.1" status: 200 len: 1094 time: 2.3046856 May 25 15:40:27.689867 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:27.699563 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40466) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:27.709598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.709598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.710250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.710598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > port after_create 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.710919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > port after_delete 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.711272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > port after_update 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.712171 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.712171 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.712461 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.712837 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.742107 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:27.742801 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.744218 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] 10.222.0.70 "PUT /v2.0/ports/cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1093 time: 3.0706680 May 25 15:40:27.762974 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-f2fc9519-a11b-41b6-b58d-b0e01db3b087 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:27.770133 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-f2fc9519-a11b-41b6-b58d-b0e01db3b087 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 816 time: 0.2842603 May 25 15:40:27.787591 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-e5d9cac8-1644-4ebe-b0bd-64ea370c2668 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/quotas/c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 375 time: 0.0165942 May 25 15:40:27.792964 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Pushing event updated for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.796972 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.871757 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.872189 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.872610 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.872900 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98463) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:27.873264 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['eb42d8f5-757c-4552-8e90-8f6270413f1c']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:27.886001 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-2e4c0446-d601-4722-b772-c1338e03b7f9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:27.910008 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-2e4c0446-d601-4722-b772-c1338e03b7f9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:27.911523 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-2e4c0446-d601-4722-b772-c1338e03b7f9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1156642 May 25 15:40:27.914975 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '546a7fff-24be-4e37-b415-b3f40224f52e') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:27.915272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '546a7fff-24be-4e37-b415-b3f40224f52e') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:27.922444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Pushing event updated for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=3']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:27.925516 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.938057 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.443s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:27.952168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.967412 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:27.978297 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Usage tracker for resource:security_group_rule and tenant:5bf91501975f4f018066edb697859cb9 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:27.981640 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:27.984169 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:27.995484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:27.999402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Releasing vlan 356 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:40:28.000035 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: from cryptography.utils import int_from_bytes May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: from cryptography.utils import int_from_bytes May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:40:28.017692 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:40:28.111316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d req-20494da2-e736-4ab8-9905-0e4842cdaadf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:28.113526 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d req-20494da2-e736-4ab8-9905-0e4842cdaadf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.5077527 May 25 15:40:28.141309 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-08e1deef-2451-494a-bfaf-e5178a8755fe service neutron] 10.222.0.36 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2179174 May 25 15:40:28.163006 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.180184 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.188652 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-92331a3d-c0b8-4f72-972a-d61570cac201 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.212548 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] 10.222.0.36 "DELETE /v2.0/networks/eb42d8f5-757c-4552-8e90-8f6270413f1c HTTP/1.1" status: 204 len: 168 time: 0.9597173 May 25 15:40:28.215162 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40486) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:28.260156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Pushing event deleted for resources: {'Network': ['ID=eb42d8f5-757c-4552-8e90-8f6270413f1c,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:28.263118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-34c337cc-f2fb-4704-8d89-38409e21996b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.278443 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f80ad1a1-d250-4fbd-94f2-03a81b2f0d7d req-6a29de2a-31ef-4706-a5af-4d4275f5d25e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1452720 May 25 15:40:28.297551 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-65bf4894-acbe-451c-a531-0a4cc9f5f430 service neutron] 10.222.0.36 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1502142 May 25 15:40:28.318736 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Deleting subnet 4c10c6a2-0abc-488b-b045-b235d0aaf20c {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:40:28.334661 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.419762 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c', 'status': 'completed', 'code': 200} May 25 15:40:28.451400 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.481869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.490928 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.504951 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:28.584292 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=5bf91501975f4f018066edb697859cb9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8795433 May 25 15:40:28.584949 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f792be9f-8d6d-412e-9c89-a7daab8ebdb7,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:28.586154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40508) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:28.587843 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.627218 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:28.857707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc', 'status': 'completed', 'code': 200} May 25 15:40:28.884957 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.944982 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:28.987295 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2319a03-e58c-4d9b-bc25-f4acea66aabd req-697f2f8f-16de-4605-90f0-058907750f91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:28.994748 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2319a03-e58c-4d9b-bc25-f4acea66aabd req-697f2f8f-16de-4605-90f0-058907750f91 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.4735446 May 25 15:40:29.046643 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-2b955407-1708-47c1-abe5-c4f33937ee5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:29.048219 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-2b955407-1708-47c1-abe5-c4f33937ee5c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1096 time: 0.4131587 May 25 15:40:29.062434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-f6cbe5ab-9886-4fdd-b4c1-e4ae468360ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:29.062998 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-221c8cf6-660d-4eec-9826-ea476bba48a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:29.068269 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-f6cbe5ab-9886-4fdd-b4c1-e4ae468360ec service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1096 time: 0.4383392 May 25 15:40:29.068631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-221c8cf6-660d-4eec-9826-ea476bba48a0 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1097 time: 0.3231230 May 25 15:40:29.085361 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2319a03-e58c-4d9b-bc25-f4acea66aabd req-0e5d6009-23d1-4a48-8e61-04142d0ec210 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0896852 May 25 15:40:29.098825 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.105818 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-081ea3bd-4330-4004-8b5a-716bc9230237 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:29.128046 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f792be9f-8d6d-412e-9c89-a7daab8ebdb7,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:29.141621 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:29.144538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.148037 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f792be9f-8d6d-412e-9c89-a7daab8ebdb7 HTTP/1.1" status: 204 len: 168 time: 0.5580151 May 25 15:40:29.179106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a84ece26-e981-4750-a0ad-0d6714207bd4 req-d75b055d-9689-44a3-90d5-29e6d5de271b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:29.180731 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a84ece26-e981-4750-a0ad-0d6714207bd4 req-d75b055d-9689-44a3-90d5-29e6d5de271b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 945 time: 0.2095022 May 25 15:40:29.230022 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.247172 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79bf8e48-a2a3-4c26-98a6-9531a295e029 req-84889863-9f4a-428c-8fe2-9dbb9ac1f209 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0555043 May 25 15:40:29.258834 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c599ada1-48b1-431c-8829-6782f1056f5b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:29.297692 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a84ece26-e981-4750-a0ad-0d6714207bd4 req-cfbe6369-d641-4599-8dfb-f10003005c16 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106966 May 25 15:40:29.301808 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.310757 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4c10c6a2-0abc-488b-b045-b235d0aaf20c,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:29.314882 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:29.321925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40534) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:29.324608 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-49ab912e-0722-4a8d-87c6-4d8236366f88 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/4c10c6a2-0abc-488b-b045-b235d0aaf20c HTTP/1.1" status: 204 len: 168 time: 1.1016700 May 25 15:40:29.516242 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.649679 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 req-8a1c3c8e-689b-4808-a7c3-b2cda109d2c5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:29.651163 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 req-8a1c3c8e-689b-4808-a7c3-b2cda109d2c5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.2159517 May 25 15:40:29.692346 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.714924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.715299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.716072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.716411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > port after_create 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.716727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > port after_delete 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.717073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > port after_update 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.717385 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.717697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.718003 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.718363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.782934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.783302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.783632 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.784025 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=98462) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 15:40:29.784382 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:29.802494 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5fffa5c5-0b94-4da3-afcb-e262acfe1a07 req-7d27a930-2c5e-4ee3-9fe1-b50d2d36291d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1389592 May 25 15:40:29.804226 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f2ae6b83-19d7-48d9-bc95-813673a81ade') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:29.804523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f2ae6b83-19d7-48d9-bc95-813673a81ade') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:29.833173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.856498 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.866838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Releasing vlan 368 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:40:29.867107 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: from cryptography.utils import int_from_bytes May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: from cryptography.utils import int_from_bytes May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:40:29.882796 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:40:29.920947 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6f230de1-4bde-4abc-ac21-bfe2eddf6700 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:29.976824 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:29.982274 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.003452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.006107 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-71013671-517e-4dec-a2a3-56f522795dff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.011262 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Pushing event deleted for resources: {'Network': ['ID=cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:30.015896 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] 10.222.0.36 "DELETE /v2.0/networks/cd4d9586-c58f-4d3e-a1f7-d6d55a18a61b HTTP/1.1" status: 204 len: 168 time: 0.6921420 May 25 15:40:30.018091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.034029 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:30.039445 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:30.040261 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.179081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.229881 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:30.265518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40576) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:30.339130 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08adb502-fc90-4849-80bf-1a6870f82cd8 req-c475fd36-7c7f-4237-a0e8-48f457c902dc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:30.340842 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-08adb502-fc90-4849-80bf-1a6870f82cd8 req-c475fd36-7c7f-4237-a0e8-48f457c902dc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.1131859 May 25 15:40:30.381215 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-49abed2c-b9ce-4193-8ec1-1a76579b5288 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=1cf5885420064bd1abad4e2199a3bb4f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1144307 May 25 15:40:30.388567 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40586) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:30.396148 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700,segment=NetworkSegment(feccb394-ccb2-48ac-98c1-f206da890375),segment_id=feccb394-ccb2-48ac-98c1-f206da890375)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:30.416370 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.421450 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.437998 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-51977735-6bbb-4743-9a77-ee82872cb8ce req-37ec4adf-a4ac-4c24-af90-1832eca6e01f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0619371 May 25 15:40:30.481847 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-08adb502-fc90-4849-80bf-1a6870f82cd8 req-bcbcd6f2-ad8f-46a3-ba63-5e3907ad704e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1351469 May 25 15:40:30.555028 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.585998 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:30.590150 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.628695 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.696043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52850869-8fd9-488f-b6e3-3c700c24158d req-dfa5d0e2-c828-4a55-80be-5d5778e47e4d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:30.697843 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-52850869-8fd9-488f-b6e3-3c700c24158d req-dfa5d0e2-c828-4a55-80be-5d5778e47e4d tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.1044185 May 25 15:40:30.712886 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.717771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:30.729654 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4573a3b4-0aa7-46fe-a3a1-95afa7b29b12,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:30.734390 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:30.738387 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:30.754717 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/4573a3b4-0aa7-46fe-a3a1-95afa7b29b12 HTTP/1.1" status: 204 len: 168 time: 0.3638446 May 25 15:40:30.779205 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700', 'code': 200} May 25 15:40:30.798563 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-52850869-8fd9-488f-b6e3-3c700c24158d req-2617f19c-dddd-4eda-9630-ec3392adee3f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929928 May 25 15:40:30.858814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:30.944676 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'status': 'completed', 'code': 200} May 25 15:40:31.051939 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d12f235d-8396-45be-a6bb-881afca274c8 req-830bdcc3-81fa-46ab-9d43-3fcf055f57ac tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:31.053400 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d12f235d-8396-45be-a6bb-881afca274c8 req-830bdcc3-81fa-46ab-9d43-3fcf055f57ac tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.0870135 May 25 15:40:31.097607 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d12f235d-8396-45be-a6bb-881afca274c8 req-c50ae2c9-d9e7-4466-846f-d534d2b699ce tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385063 May 25 15:40:31.201113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40616) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:31.251934 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ebed2b8d-084d-4963-9d0f-ad9503b0dcc6 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=7296eb2670794e5f804c74fd75621a37&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0496531 May 25 15:40:31.254467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40620) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:31.311305 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.336384 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.391276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.394816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3d724008-9528-467f-a46e-0a71dc8c1f8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:31.405281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7990e26a-5a2f-4e1e-b92b-ff3c94634b55,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:31.410587 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:31.412517 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:31.413856 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/7990e26a-5a2f-4e1e-b92b-ff3c94634b55 HTTP/1.1" status: 204 len: 168 time: 0.1582012 May 25 15:40:31.603002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ce9440a4-4866-4433-9c5c-5d5f66d53b76 req-a79fb68f-7650-46bc-aab8-5f38c1bc7f8c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0498192 May 25 15:40:31.676065 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-091b21aa-440a-4893-b9ab-b82c9dda6f94 req-3fa8edcc-bd64-4ff4-88c6-2cdbe100edb8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:31.677598 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-091b21aa-440a-4893-b9ab-b82c9dda6f94 req-3fa8edcc-bd64-4ff4-88c6-2cdbe100edb8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.0843182 May 25 15:40:31.720886 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-091b21aa-440a-4893-b9ab-b82c9dda6f94 req-add297bf-b1d7-49e5-b188-eafd907079e4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376885 May 25 15:40:32.081763 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-b29f1795-bd29-441c-9b11-3499ee9799b3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 217 time: 0.0753987 May 25 15:40:32.192972 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-f17393ea-cd52-4115-a7f3-687d6620c1f4 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.1485000 May 25 15:40:32.385093 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e346219c-2540-4c36-b2ce-ea93f6c73a47 req-069f1731-85d8-4a2b-a9c4-be7268ca169e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.411593 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e346219c-2540-4c36-b2ce-ea93f6c73a47 req-069f1731-85d8-4a2b-a9c4-be7268ca169e tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.4994845 May 25 15:40:32.431568 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-86837530-bfaf-4fc9-93b8-394083dfa8d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.445025 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-86837530-bfaf-4fc9-93b8-394083dfa8d7 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.3349895 May 25 15:40:32.476351 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-9333e2cf-c48a-4faf-9889-28db312cf1b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.478691 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-9333e2cf-c48a-4faf-9889-28db312cf1b7 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.2777114 May 25 15:40:32.557950 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-b5036959-df3d-40a2-9407-d90c03c33d95 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0665627 May 25 15:40:32.580230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 req-018e2e27-c749-4878-a031-b696ede79a64 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.588360 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 req-018e2e27-c749-4878-a031-b696ede79a64 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.2894495 May 25 15:40:32.617721 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:32.661232 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-521cd291-a9c5-4865-a2b5-dd8f9627cbeb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:32.661787 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e346219c-2540-4c36-b2ce-ea93f6c73a47 req-e21ebf2e-8ee9-4155-ad7b-b45df9d98e17 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2491691 May 25 15:40:32.668408 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-78903784-287b-4d7d-8f42-710f408fd826 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.672430 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-78903784-287b-4d7d-8f42-710f408fd826 service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&shared=False HTTP/1.1" status: 200 len: 920 time: 0.5877173 May 25 15:40:32.705765 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-410063f0-0a4b-4743-9d5e-f287c33c09f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.707393 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-410063f0-0a4b-4743-9d5e-f287c33c09f3 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 1099 time: 0.3507638 May 25 15:40:32.769314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-5b590b58-84aa-4d30-a504-b489137a0c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:32.771060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-5b590b58-84aa-4d30-a504-b489137a0c48 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2921736 May 25 15:40:32.789879 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-10c0cbe2-b051-42e2-9ab0-8bb70a2ab7d4 req-e07f9839-35e4-474e-92e4-c872a15dc046 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1870363 May 25 15:40:32.793301 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:32.906915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:32.922054 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Usage tracker for resource:security_group_rule and tenant:2e53fbc40fa14a658bf73f8b4fc5f7b2 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:32.931462 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:32.983157 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:32.993752 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-823dfcd4-1de4-4e3d-8361-b1d07e179240 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4250567 May 25 15:40:33.000244 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-de1fcb2f-0c6d-42b4-bd21-d1433b1e5e9a service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2178490 May 25 15:40:33.119789 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-37a939b3-6fb8-40f3-a339-a0d12fff5e71 req-c0e5ee08-e470-438a-9960-c40523b56411 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.1179774 May 25 15:40:33.121548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-15ff428c-92b1-45f0-9145-dac75c6667b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.124010 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c44cd1d0-ecb6-4919-88ab-192f91715408 req-15ff428c-92b1-45f0-9145-dac75c6667b5 service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.4426227 May 25 15:40:33.180645 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.70', 61864) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:33.429613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:33.538705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-ba17d31e-d939-469f-bd04-269cb9660374 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.540478 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-ba17d31e-d939-469f-bd04-269cb9660374 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1097 time: 0.3518507 May 25 15:40:33.648071 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:33.654897 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-699f6a94-f245-4376-bcd7-a10f5ab4f5ef req-45cbd93b-98a1-4a45-b536-087d719c6645 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6427457 May 25 15:40:33.669884 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64c72f89-ce46-43a9-8ea6-66355a683c2d req-2a89a717-6642-4956-ba00-7d49ac56e5bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.678652 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-64c72f89-ce46-43a9-8ea6-66355a683c2d req-2a89a717-6642-4956-ba00-7d49ac56e5bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.5241909 May 25 15:40:33.681369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:33.690910 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:33.713067 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-d34e7f5f-a54f-4736-9d07-e6da9df5ef14 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c HTTP/1.1" status: 200 len: 217 time: 0.1478286 May 25 15:40:33.723649 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe26a1f5-322f-473e-ac7d-418cfc7ec05a req-69f02779-6891-41e9-ae17-d39e425698c4 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5985589 May 25 15:40:33.784439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=d978a652-ece8-4a25-92d5-794861e60137,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:33.791535 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-2f09a7be-35e0-4b8d-9df3-14ac29f0ebc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.793472 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-2f09a7be-35e0-4b8d-9df3-14ac29f0ebc2 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.0685344 May 25 15:40:33.800711 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:33.852479 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1237984 May 25 15:40:33.871926 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-64c72f89-ce46-43a9-8ea6-66355a683c2d req-2173f7a8-e2c8-4684-9597-d3fe63251773 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1924043 May 25 15:40:33.895231 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-924f614c-e208-46f7-8584-240393e9fe55 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0897012 May 25 15:40:33.917428 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198aa571-2420-4884-bcf8-4d804486cc3f req-25bd8ae1-5154-42b4-85cf-612fd2f1cc20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.918982 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-25bd8ae1-5154-42b4-85cf-612fd2f1cc20 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1096 time: 0.1146231 May 25 15:40:33.949548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-3de31d93-301d-4e1d-a5d3-8316efbf0944 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:33.950991 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-3de31d93-301d-4e1d-a5d3-8316efbf0944 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 816 time: 0.7715788 May 25 15:40:34.121892 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-8b99cb54-ef15-40e0-860c-1c54a3bdee6c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 380 time: 0.1513343 May 25 15:40:34.156840 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-60b6fc3f-b97f-4979-84f5-a77767dc62bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:34.158335 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-60b6fc3f-b97f-4979-84f5-a77767dc62bd service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1096 time: 0.3639078 May 25 15:40:34.179460 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 req-03acc09d-5dfd-4343-9ec4-4104b4310024 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:34.181715 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 req-11f02f6f-3d05-4b67-8834-0c9e957940af tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:34.181837 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 req-03acc09d-5dfd-4343-9ec4-4104b4310024 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.1354163 May 25 15:40:34.183216 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 req-11f02f6f-3d05-4b67-8834-0c9e957940af tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2907946 May 25 15:40:34.184912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5cb8f406-d2f7-4a99-8229-313874782501 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:34.186503 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-5cb8f406-d2f7-4a99-8229-313874782501 service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.2176564 May 25 15:40:34.192286 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-a635f561-9978-4af9-a385-8822640b3a3e service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2252519 May 25 15:40:34.244475 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d15eb3ae-6b1c-4a06-a62e-da6eddbc96a4 req-d55936ba-61d4-4b67-a2c2-6bf1fe3d86c2 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511413 May 25 15:40:34.249977 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38dbb551-65a9-4414-a4c8-0b8b270bcf60 req-bc9ecca7-c547-4806-86c5-c1f1137766a8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573027 May 25 15:40:34.330292 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40754) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:34.398758 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2ed2420f-a95c-4cb0-9c27-d8271ec5dda2 req-6b2dc0be-b69f-409b-9329-f20c8637b252 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0426078 May 25 15:40:34.468284 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.482967 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:34.486729 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Usage tracker for resource:security_group_rule and tenant:14bcb0eaec2f46db9fcecbb53e0662d2 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:34.489623 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:34.495344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:34.585359 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.595402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.604091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e7314901-caf8-4714-a904-77e783559822 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.646012 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=14bcb0eaec2f46db9fcecbb53e0662d2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3109632 May 25 15:40:34.646012 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=55004712-22dd-41b1-a7c3-0d7caf2531ae,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:34.646583 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40768) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:34.657167 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.705199 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.731729 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.793409 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.801934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5eeaf3cb-f56b-47c4-91e1-abf3f952e1b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:34.899282 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=55004712-22dd-41b1-a7c3-0d7caf2531ae,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:34.901873 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:34.903485 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:34.904603 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/55004712-22dd-41b1-a7c3-0d7caf2531ae HTTP/1.1" status: 204 len: 168 time: 0.2567613 May 25 15:40:35.106344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 req-638578b8-2ccf-4be3-b953-d22ef961a002 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:35.113600 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 req-638578b8-2ccf-4be3-b953-d22ef961a002 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.1082351 May 25 15:40:35.153682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.162757 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-41cbd0ad-4d03-42ad-bf59-9aa7da0adf15 req-0c0b8ff0-0ebc-4158-87b9-f8f8fe64acce tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480928 May 25 15:40:35.248660 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40804) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:35.367967 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40816) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:35.448271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.468575 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.490619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:35.495458 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:35.496353 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc req-93266551-f87f-41af-9077-4ba2c941c8e7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:35.497830 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc req-93266551-f87f-41af-9077-4ba2c941c8e7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.0817618 May 25 15:40:35.500655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Usage tracker for resource:security_group_rule and tenant:4dbfa30263e44d20a6a78251835475d7 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:35.503405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Usage tracker for resource:security_group_rule and tenant:d6e29abb37cf46b5bdbf6dc653ed6fc6 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:35.506888 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:35.511329 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:35.522851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:35.524907 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:35.543405 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-53a1e6fa-83de-46c8-b8f4-50b6d8aba8dc req-f1b5f80d-a44b-4da2-b884-406b3a5a338a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397675 May 25 15:40:35.570281 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 req-b97a959b-7d7a-41ae-9368-29acecb5b5e9 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:35.571756 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 req-b97a959b-7d7a-41ae-9368-29acecb5b5e9 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2054865 May 25 15:40:35.654117 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c6a3b146-b446-48ed-adb0-4ee8da8e6f38 req-fdf08ccd-d948-4e87-96a5-312d63b5ada0 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731952 May 25 15:40:35.711198 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c0965732-9e6a-468a-b2fd-5d815091b4e6 req-2e26cd99-e1c7-47d8-bc81-ccc44028d55d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0581985 May 25 15:40:35.723375 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.731020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.732146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.740897 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.750364 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.803668 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=d6e29abb37cf46b5bdbf6dc653ed6fc6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4024234 May 25 15:40:35.806372 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40828) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:35.808244 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cfddb53-07f3-49e2-93f4-9c4c294f9477,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:35.814927 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=4dbfa30263e44d20a6a78251835475d7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5645924 May 25 15:40:35.816757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.817302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.042s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.823507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40832) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:35.867271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48ba1495-c711-4f1f-8d3e-5ebe4ce10105,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:35.868301 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.876321 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.894788 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.900642 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.927093 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.946494 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.951401 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:35.964275 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cfddb53-07f3-49e2-93f4-9c4c294f9477,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:35.966789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:35.976864 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.980359 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/2cfddb53-07f3-49e2-93f4-9c4c294f9477 HTTP/1.1" status: 204 len: 168 time: 0.1699290 May 25 15:40:35.986903 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:35.992799 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.004618 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48ba1495-c711-4f1f-8d3e-5ebe4ce10105,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:36.006810 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.013986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.015102 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/48ba1495-c711-4f1f-8d3e-5ebe4ce10105 HTTP/1.1" status: 204 len: 168 time: 0.1906567 May 25 15:40:36.364655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-636138d2-09b6-48d4-a39a-532476577736 req-771abe86-4d38-4c5d-8f6e-404053b211e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:36.366676 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-636138d2-09b6-48d4-a39a-532476577736 req-771abe86-4d38-4c5d-8f6e-404053b211e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.0933316 May 25 15:40:36.381040 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 40852) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:36.404427 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.415786 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-636138d2-09b6-48d4-a39a-532476577736 req-d454266f-bd1b-4c50-b85e-7d6eec5cefe0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434599 May 25 15:40:36.422925 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:36.427297 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Usage tracker for resource:security_group_rule and tenant:3b35ae43cd1b4bc088be694877657728 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:36.430801 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:36.436313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:36.524198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.528768 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.538253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f8f6d2c-9b98-466d-a398-ec453711befa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.580511 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=3b35ae43cd1b4bc088be694877657728&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1953733 May 25 15:40:36.580511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=019a7035-26b3-4350-a8aa-6eda3ce54af8,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:36.581677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 40864) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:36.582503 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.650480 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.677783 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.738953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.745413 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 req-64a1b453-73f3-4982-a562-a9f7a3b4a57e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:36.746862 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 req-64a1b453-73f3-4982-a562-a9f7a3b4a57e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.0868857 May 25 15:40:36.748699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c0ebf932-8505-47aa-9739-c7d3f195a521 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:36.760089 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=019a7035-26b3-4350-a8aa-6eda3ce54af8,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:36.776120 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:36.804144 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbe2a6c3-67a5-48a2-a3ae-9d23aabc9ab8 req-c71b9a89-70bd-40fb-84b6-ba218d453b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407538 May 25 15:40:36.823312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:36.824432 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/019a7035-26b3-4350-a8aa-6eda3ce54af8 HTTP/1.1" status: 204 len: 168 time: 0.2417099 May 25 15:40:36.890562 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4777ed36-3540-4864-8bfc-b5028b507ada req-7654ff9b-c42a-43f6-8730-2f596c4f191a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:36.894749 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4777ed36-3540-4864-8bfc-b5028b507ada req-7654ff9b-c42a-43f6-8730-2f596c4f191a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.1138535 May 25 15:40:36.958053 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4777ed36-3540-4864-8bfc-b5028b507ada req-52553ec6-854c-44f3-9f37-a492dd967bfc tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589323 May 25 15:40:37.004873 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-15030781-9e11-4bc8-b45d-a54950799115 req-07161b1d-4274-4cc5-90e5-e00ea0cf6729 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0480988 May 25 15:40:37.109683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'port': {'device_id': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'admin_state_up': True, 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'security_groups': ['c337eddc-a70e-4a8c-8701-85a39104333d']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:37.175798 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-7f2890df-b1ae-4b0e-937b-068983354344 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 217 time: 0.0683267 May 25 15:40:37.251505 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198aa571-2420-4884-bcf8-4d804486cc3f req-f341acb2-dd13-42f4-8a3a-080930cbb2d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:37.254201 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-f341acb2-dd13-42f4-8a3a-080930cbb2d3 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0718899 May 25 15:40:37.341927 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198aa571-2420-4884-bcf8-4d804486cc3f req-ed217ea3-5931-40fa-931d-2a658fd90e85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:37.343623 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-ed217ea3-5931-40fa-931d-2a658fd90e85 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0804176 May 25 15:40:37.465543 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-06055484-5a94-4a99-9a6b-0b152e03ebd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:37.467017 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-06055484-5a94-4a99-9a6b-0b152e03ebd8 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.3300436 May 25 15:40:37.527712 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-80f12666-778b-49ac-aa64-b04dba5b571e service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1714087 May 25 15:40:37.572589 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d306c9d-83b1-45f7-b7d1-db71b6095aad req-587649e0-ae8b-4e54-8354-53e0c0e97a3e service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4368482 May 25 15:40:37.573792 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-5e5e1315-b136-439a-8ad1-24e7b24f0d78 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.0930169 May 25 15:40:37.721089 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-198aa571-2420-4884-bcf8-4d804486cc3f req-c02f7818-1262-4e38-8be9-47f218c28c42 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1830966 May 25 15:40:37.766723 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:37.784851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:37.787686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-a08d3a1e-341a-49af-9c44-a79b16fcc84e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:37.789349 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-a08d3a1e-341a-49af-9c44-a79b16fcc84e service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.1986110 May 25 15:40:37.835525 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Made reservation on behalf of c00f6cd8c3154d2f835d5f59da9cc7e3 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:37.838548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:37.868967 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-729619fc-caef-402d-8dfd-3ab853853e8e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0673270 May 25 15:40:38.012992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1d46c8-b608-45ed-919d-b1345e9bea61 req-22793bec-843f-4280-b200-a34fdf50d57c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:38.014489 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ce1d46c8-b608-45ed-919d-b1345e9bea61 req-22793bec-843f-4280-b200-a34fdf50d57c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.3271182 May 25 15:40:38.178710 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 req-76b5d4e6-9807-467f-a5bc-91ef971d925d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:38.189412 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 req-76b5d4e6-9807-467f-a5bc-91ef971d925d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.2011621 May 25 15:40:38.255532 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ce1d46c8-b608-45ed-919d-b1345e9bea61 req-2016faf1-46c8-4c93-b5cf-7afc198c9a93 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1501524 May 25 15:40:38.290825 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-dc66ab0c-22ae-42f3-b13e-246ccdcab13c service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3716385 May 25 15:40:38.295013 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Allocated IP 172.20.0.11 (76bea034-0890-4bf6-b793-280aaec1a32c/2ce66291-0ef8-4b15-9e67-ba32027661fc/3f734a1c-be04-4203-b351-6b0b6785f9ae) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:38.296574 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-af9dc2bf-0720-483a-860e-e62a28fdcaa0 req-2283b288-911e-463a-b681-32b962e94eec tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1038375 May 25 15:40:38.513651 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-88188e85-3043-41a8-8080-3084cb6e9fd9 req-8e162e48-6602-44d9-a10f-4aeeb712f890 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0643361 May 25 15:40:38.851305 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fd13adc9-9021-4bc4-bb61-26996dfa4861 req-42fcc471-1e7e-43a8-b9ea-119d064ef0a8 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5491085 May 25 15:40:38.901751 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ec0ed38-16fd-4629-a03b-4f44134b15ea req-9358cec5-b328-41d3-8260-8e362c3fa5ba tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:38.903399 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ec0ed38-16fd-4629-a03b-4f44134b15ea req-9358cec5-b328-41d3-8260-8e362c3fa5ba tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.3313890 May 25 15:40:38.980405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:38.993951 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ec0ed38-16fd-4629-a03b-4f44134b15ea req-d2c55828-0874-4750-bbd7-a398bc239a8a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0801580 May 25 15:40:39.014270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Transition to ACTIVE for port object 3f734a1c-be04-4203-b351-6b0b6785f9ae will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:39.051889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.094490 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41004) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:39.100942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.177218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Network 76bea034-0890-4bf6-b793-280aaec1a32c is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:39.181262 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:39.199894 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:39.320294 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:39.371855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:39.429579 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:39.430264 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.514459 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4100654 May 25 15:40:39.529449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Request body: {'port': {'device_id': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:39.630774 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-c225df74-241c-4285-89ec-a134e358a7a1 None None] Provisioning for port 3f734a1c-be04-4203-b351-6b0b6785f9ae completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:39.636307 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-c225df74-241c-4285-89ec-a134e358a7a1 None None] Provisioning complete for port 3f734a1c-be04-4203-b351-6b0b6785f9ae triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:39.636762 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-c225df74-241c-4285-89ec-a134e358a7a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.652780 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.687114 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:39.693460 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Usage tracker for resource:security_group_rule and tenant:a21cfa2d4b3e460c9ecfd46294a4a78c is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:39.695676 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-c225df74-241c-4285-89ec-a134e358a7a1 None None] Port 3f734a1c-be04-4203-b351-6b0b6785f9ae cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:39.696595 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:39.707645 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:39.728925 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 req-ee7b8929-8f51-46f9-ba5e-73bb3dacb1c3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:39.730439 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 req-ee7b8929-8f51-46f9-ba5e-73bb3dacb1c3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.1547940 May 25 15:40:39.771316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.793873 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b6e37f8b-e737-4929-a4fb-caaac6bd6fe5 req-f417c96b-d049-484e-bf04-f00deaee327a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0547905 May 25 15:40:39.867777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.872432 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:39.878670 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e req-5863f6e8-12c6-445d-9ed9-96ab20e7777c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:39.880260 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e req-5863f6e8-12c6-445d-9ed9-96ab20e7777c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.2969313 May 25 15:40:39.910700 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-753c7418-dd8c-484d-b143-440ee366099c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:39.920293 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=a21cfa2d4b3e460c9ecfd46294a4a78c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8247521 May 25 15:40:39.922939 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41046) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:40.003600 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dcb30e6b-04d0-4e45-bd23-0987a1121d5e req-a6eebff2-f273-4a3a-8d62-1568b5ced615 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121628 May 25 15:40:40.021633 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=faa4772d-f60d-46b1-9509-79cd4e5f8000,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:40.024919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.083381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.096847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92874306-9224-45fd-bfa1-e0ed9673e33e req-848bf96d-86b6-412e-9e73-ca4592568f19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:40.098373 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-92874306-9224-45fd-bfa1-e0ed9673e33e req-848bf96d-86b6-412e-9e73-ca4592568f19 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 932 time: 0.1441228 May 25 15:40:40.158598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.187192 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-92874306-9224-45fd-bfa1-e0ed9673e33e req-f3e3308e-1d0a-46bc-888d-0a39fa9e1924 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:40.248710 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-92874306-9224-45fd-bfa1-e0ed9673e33e req-f3e3308e-1d0a-46bc-888d-0a39fa9e1924 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:40.250233 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-92874306-9224-45fd-bfa1-e0ed9673e33e req-f3e3308e-1d0a-46bc-888d-0a39fa9e1924 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1403754 May 25 15:40:40.270168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.279569 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.295913 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.297015 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/faa4772d-f60d-46b1-9509-79cd4e5f8000 HTTP/1.1" status: 204 len: 168 time: 0.3731480 May 25 15:40:40.314265 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=faa4772d-f60d-46b1-9509-79cd4e5f8000,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:40.319984 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.343594 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:40.358637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef req-f417b2f6-f174-4a1d-ae7e-4dd1e26c177b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:40.360273 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef req-f417b2f6-f174-4a1d-ae7e-4dd1e26c177b tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.1942532 May 25 15:40:40.362631 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.397218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Transition to ACTIVE for port object 3f734a1c-be04-4203-b351-6b0b6785f9ae will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:40.409860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.418041 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c53a9b6-df0b-4952-9cd7-2f4806bed331 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:40.462434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7d19ee49-a0fe-4a84-bed2-005b86ff9aef req-0a507426-85ac-4b46-a29e-880e5d6c6f2a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0922587 May 25 15:40:40.555181 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:40.582980 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:40.591452 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.677459 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Attempting to bind port 3f734a1c-be04-4203-b351-6b0b6785f9ae on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:40.678029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Attempting to bind port 3f734a1c-be04-4203-b351-6b0b6785f9ae by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:40.678906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Attempting to bind port 3f734a1c-be04-4203-b351-6b0b6785f9ae on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:40.685182 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Port 3f734a1c-be04-4203-b351-6b0b6785f9ae on network 76bea034-0890-4bf6-b793-280aaec1a32c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:40:40.686014 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Attempting to bind port 3f734a1c-be04-4203-b351-6b0b6785f9ae on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:40.693882 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:40.694664 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Checking segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:40.695234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Bound using segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:40.696264 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Bound port: 3f734a1c-be04-4203-b351-6b0b6785f9ae, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:40.705412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.763377 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41070) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:40.783186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.800351 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:40.804816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Usage tracker for resource:security_group_rule and tenant:13df1a83c1474bcaa8bdbff8de8c3742 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:40.808775 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:40.820746 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:40.971106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:40.976351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:40.984161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.995258 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:40.996449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.066371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.067371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.068873 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] 10.222.0.70 "PUT /v2.0/ports/3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 1094 time: 1.5441012 May 25 15:40:41.069344 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:41.121573 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.125625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:41.130919 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.186377 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-039ddf40-e5e7-4e0d-a312-52ffb82dcbcf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.202079 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=13df1a83c1474bcaa8bdbff8de8c3742&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4374142 May 25 15:40:41.204570 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41086) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:41.244035 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:40:41.257596 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d3d9318-75d1-4e0c-9c49-6ff455b33ff1,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:41.290317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.392453 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479288ad-f9b2-4411-8e43-991169036190 req-29db609e-070e-484c-b8e8-58e6444171e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.401524 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-479288ad-f9b2-4411-8e43-991169036190 req-29db609e-070e-484c-b8e8-58e6444171e8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 943 time: 0.4113607 May 25 15:40:41.450869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.459518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-1df32338-2011-4036-831d-27df8b02181b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.462666 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-1df32338-2011-4036-831d-27df8b02181b service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1097 time: 0.3295205 May 25 15:40:41.508504 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.556833 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:41.566475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88f49b9-5e75-4007-a90d-c7d7dd00481b req-353ea920-f0db-4f3e-abb9-3b29f12baa44 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.572242 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'port_id': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'mac_address': 'fa:16:3e:1b:62:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 364, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:40:41.574354 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e88f49b9-5e75-4007-a90d-c7d7dd00481b req-353ea920-f0db-4f3e-abb9-3b29f12baa44 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 944 time: 0.3620923 May 25 15:40:41.599221 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-479288ad-f9b2-4411-8e43-991169036190 req-16cf5677-3e92-4c9f-aa3b-44a488b21774 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1930420 May 25 15:40:41.617082 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-f9f355c6-fa67-4c07-84de-e33167353b84 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 217 time: 0.1368504 May 25 15:40:41.638249 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.645023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-dfe04f3a-3b4b-4d74-b845-f6213cc13847 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.672025 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e88f49b9-5e75-4007-a90d-c7d7dd00481b req-d8446670-a5a1-4a6b-9aaf-d116809215aa tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967371 May 25 15:40:41.677611 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.680442 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d3d9318-75d1-4e0c-9c49-6ff455b33ff1,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:41.687815 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:41.689093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.702403 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/2d3d9318-75d1-4e0c-9c49-6ff455b33ff1 HTTP/1.1" status: 204 len: 168 time: 0.4907558 May 25 15:40:41.705501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-1c78f1e7-4ab8-4858-a965-0c8808f90238 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.708597 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-1c78f1e7-4ab8-4858-a965-0c8808f90238 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0872965 May 25 15:40:41.713109 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'status': 'completed', 'code': 200} May 25 15:40:41.726037 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:41.757601 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:41.765082 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:41.766016 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:40:41.767921 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:41.906135 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:41.907620 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-8b06a4cd-44fe-40dc-88c9-e42f945ab60f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:41.909904 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-8b06a4cd-44fe-40dc-88c9-e42f945ab60f service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1917179 May 25 15:40:41.912124 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.031164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02033166-4ca5-49bf-a7dd-03d27b604c3e req-a7534d36-8668-4646-8da8-81a030787242 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:42.031933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-02033166-4ca5-49bf-a7dd-03d27b604c3e req-a7534d36-8668-4646-8da8-81a030787242 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:40:42.083877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-02033166-4ca5-49bf-a7dd-03d27b604c3e req-a7534d36-8668-4646-8da8-81a030787242 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:40:42.085076 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02033166-4ca5-49bf-a7dd-03d27b604c3e req-a7534d36-8668-4646-8da8-81a030787242 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.2507627 May 25 15:40:42.100779 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:42.116821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'port_id': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc', 'mac_address': 'fa:16:3e:b4:63:de', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:40:42.118834 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-de357b9f-d6b2-4b36-b078-ea0ebfbb090e service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2008903 May 25 15:40:42.195592 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:42.214238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:42.218795 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02033166-4ca5-49bf-a7dd-03d27b604c3e req-5f44a28c-f2c0-4512-a051-6d7d3a5a2a02 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1236324 May 25 15:40:42.232148 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:42.238238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:42.239307 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 58598550-b0ed-4b7c-a4d8-2e58f345261c details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:40:42.241870 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.271282 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:40:42.312497 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7995dedf-0f5e-4ea9-9ed2-eb948a3fb706 req-c5301096-d717-4ee9-a8e3-f4f5c4690be7 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1805036 May 25 15:40:42.333392 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:42.338205 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.342634 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:42.359398 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '58598550-b0ed-4b7c-a4d8-2e58f345261c', 'network_id': 'db198222-1495-44ec-99cd-cc38de1c71df', 'port_id': '58598550-b0ed-4b7c-a4d8-2e58f345261c', 'mac_address': 'fa:16:3e:c8:9a:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 355, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'eae8c611-60f5-420f-b883-17fbae330f18', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:40:42.424232 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:42.448921 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 58598550-b0ed-4b7c-a4d8-2e58f345261c {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:42.479188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1547634d-df43-43c8-aecd-92d402c51734 req-c54e7372-4f47-48a1-88aa-c94d02a2276c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:42.479188 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-c54e7372-4f47-48a1-88aa-c94d02a2276c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1097 time: 0.0989094 May 25 15:40:42.479611 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:42.484297 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:42.486568 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:42.571853 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:42.577291 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:42.651138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1547634d-df43-43c8-aecd-92d402c51734 req-243781d7-aa9f-46f4-aa71-b5ae9019b66a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:42.652669 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-243781d7-aa9f-46f4-aa71-b5ae9019b66a service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1647279 May 25 15:40:42.780535 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-2359827c-3a88-4239-8957-c88852ab9786 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 217 time: 0.1146114 May 25 15:40:42.865425 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['58598550-b0ed-4b7c-a4d8-2e58f345261c'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:40:42.931253 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:40:42.964167 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1547634d-df43-43c8-aecd-92d402c51734 req-52e87232-7122-4bfc-b9e0-140c97ae5c66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:42.966182 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-52e87232-7122-4bfc-b9e0-140c97ae5c66 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.1781976 May 25 15:40:42.977213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:40:43.026200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41158) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:43.069436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906c85b6-9348-414b-bb05-25d6156e46f5 req-d4e6b438-c843-4445-99f4-857117e8977a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:43.073568 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-906c85b6-9348-414b-bb05-25d6156e46f5 req-d4e6b438-c843-4445-99f4-857117e8977a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.2290304 May 25 15:40:43.255064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-906c85b6-9348-414b-bb05-25d6156e46f5 req-ce398600-e281-46ac-9656-c315d1f3ca95 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1591015 May 25 15:40:43.292319 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1547634d-df43-43c8-aecd-92d402c51734 req-8c19623b-f1cc-4d96-866c-f4cfbca9a274 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:43.293868 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-8c19623b-f1cc-4d96-866c-f4cfbca9a274 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3170938 May 25 15:40:43.374837 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:43.437391 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:43.446993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Usage tracker for resource:security_group_rule and tenant:c2763d2a684f4e60863d22ad158b5695 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:43.453848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:43.470513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:43.613569 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41182) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:43.716173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:43.722157 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:43.731081 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-11d81831-0ed8-49da-bd94-0668b053e28a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:43.777806 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-8a2b9954-cbb6-4f0d-b942-7cb12858f65e service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4730155 May 25 15:40:43.788917 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c2763d2a684f4e60863d22ad158b5695&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7614985 May 25 15:40:43.791996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41194) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:43.798994 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=095a3eb8-8194-4c2a-a7ea-c9e80949bbf1,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:43.802927 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:43.826989 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:43.832477 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8409a92-0662-4a49-828f-077ed4a88d18 req-e4c488cc-fc35-4bab-b6e6-cffff80812b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:43.833964 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f8409a92-0662-4a49-828f-077ed4a88d18 req-e4c488cc-fc35-4bab-b6e6-cffff80812b7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.2170854 May 25 15:40:43.842111 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:43.858811 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Usage tracker for resource:security_group_rule and tenant:fd87163599ea4f5db80d786238c167b0 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:43.864890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:43.865328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b138e3-b359-4285-905b-d3ca84c29293 req-c61a3ea5-68d8-45fb-9ee4-3df81005bfa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:43.867364 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f5b138e3-b359-4285-905b-d3ca84c29293 req-c61a3ea5-68d8-45fb-9ee4-3df81005bfa2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 945 time: 0.1857581 May 25 15:40:43.873068 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:43.904823 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:43.906190 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f8409a92-0662-4a49-828f-077ed4a88d18 req-331a8f47-25c0-40cf-a81d-ef0df7ac95d8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651824 May 25 15:40:43.944124 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f5b138e3-b359-4285-905b-d3ca84c29293 req-cf596059-4826-4733-ba17-bae0e9389be8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639522 May 25 15:40:43.948168 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.000203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.002402 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.005009 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.008962 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-40e287aa-bf07-476d-9fe4-824f350480b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.013755 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2dd5c9ea-8b5f-4cd6-abd7-e2b457d59717 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.022303 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=095a3eb8-8194-4c2a-a7ea-c9e80949bbf1,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:44.024612 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.026486 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.027337 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/095a3eb8-8194-4c2a-a7ea-c9e80949bbf1 HTTP/1.1" status: 204 len: 168 time: 0.2344148 May 25 15:40:44.057595 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=fd87163599ea4f5db80d786238c167b0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4426029 May 25 15:40:44.058572 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f61fe53d-0ea0-4bf7-8f33-0628ada6dbe4,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:44.060346 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41200) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:44.061818 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.121846 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.152491 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.209080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.214391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:44.226604 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f61fe53d-0ea0-4bf7-8f33-0628ada6dbe4,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:44.228906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:44.232369 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:44.236494 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f61fe53d-0ea0-4bf7-8f33-0628ada6dbe4 HTTP/1.1" status: 204 len: 168 time: 0.1718102 May 25 15:40:44.444981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03145613-3e08-41ad-94e1-e1e676da5937 req-3e5283ef-7415-4fbb-ab22-137bc7ec6500 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:44.447011 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-03145613-3e08-41ad-94e1-e1e676da5937 req-3e5283ef-7415-4fbb-ab22-137bc7ec6500 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.0818155 May 25 15:40:44.497347 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-03145613-3e08-41ad-94e1-e1e676da5937 req-49104a00-0b79-4adf-b856-93e175d4a19d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445008 May 25 15:40:45.028303 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41258) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:45.138492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc79e29-236f-4067-aff1-23d70b0eb4e7 req-a846686c-6a49-436c-b2a0-b596df9c7b7c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:45.148136 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-afc79e29-236f-4067-aff1-23d70b0eb4e7 req-a846686c-6a49-436c-b2a0-b596df9c7b7c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1126912 May 25 15:40:45.172892 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 req-8b2444b9-f118-43ac-bfc1-6f21d2e50767 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:45.181692 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 req-8b2444b9-f118-43ac-bfc1-6f21d2e50767 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 945 time: 0.1073797 May 25 15:40:45.229753 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2401b34c-f42b-4b26-af64-b7ffb8be74d5 req-0aa10483-538d-4e0c-851e-c1ac9d2fb181 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466406 May 25 15:40:45.235532 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1925733587-network', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:45.241635 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:45.246642 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Usage tracker for resource:network and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:45.248540 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-afc79e29-236f-4067-aff1-23d70b0eb4e7 req-3b5d3c14-04dd-4177-a0dc-fad60d6f0eef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0986769 May 25 15:40:45.251756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:45.266122 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:45.289077 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Made reservation on behalf of 55dc60a2768e4d2db35d44c21ff0e0a6 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:45.291981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.310436 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.333282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:45.338929 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:45.365966 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:45.372220 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:45.481714 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.486404 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.492005 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e106e9d0-5218-4a66-b092-d5cfd065efa7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:45.516904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 398} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:40:45.529960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:45.534588 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:45.536513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.536860 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Added segment e4241c72-10f5-428f-970e-cab7555df934 of type vlan for network 07e4e701-ccf8-451e-b3d9-a809a6936fed May 25 15:40:45.571296 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.606981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.608461 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:45.609045 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:45.614868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-509ea2a4-fb5f-48aa-9691-95b0418954dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:45.777174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Pushing event updated for resources: {'Network': ['ID=07e4e701-ccf8-451e-b3d9-a809a6936fed,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:45.781730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:45.785409 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.7559886 May 25 15:40:45.788343 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41274) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:45.788701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:40:45.793769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Request body: {'subnet': {'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1925733587-subnet', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:45.799414 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:45.804790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Usage tracker for resource:subnet and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:45.809446 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:45.816613 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:45.836637 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11a9df65-f9f3-4528-826e-36317f3f22b3 req-2c65d61c-f5ae-4747-8cfa-8eb3f24173eb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:45.838092 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11a9df65-f9f3-4528-826e-36317f3f22b3 req-2c65d61c-f5ae-4747-8cfa-8eb3f24173eb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.1999438 May 25 15:40:45.839257 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Made reservation on behalf of 55dc60a2768e4d2db35d44c21ff0e0a6 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:45.841370 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.014979 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11a9df65-f9f3-4528-826e-36317f3f22b3 req-67ac79e3-a89b-4b5d-89e2-eda318322b66 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1603322 May 25 15:40:46.307637 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.312226 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:46.437507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:46.441329 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2e41c1d-88e3-4592-943f-311b1745a3f5 req-195e2d84-6e76-4b13-a499-762de01ce81c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:46.442712 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:46.442835 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e2e41c1d-88e3-4592-943f-311b1745a3f5 req-195e2d84-6e76-4b13-a499-762de01ce81c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 945 time: 0.0860498 May 25 15:40:46.451815 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Checking segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:46.452213 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Network hostable DHCP agents. Network: 07e4e701-ccf8-451e-b3d9-a809a6936fed, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:40:46.488140 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4690fa-0276-4d0b-9569-fbb84147c513 req-b29d6b33-3ee1-4481-b38c-9a346de53fd7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:46.489631 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1c4690fa-0276-4d0b-9569-fbb84147c513 req-b29d6b33-3ee1-4481-b38c-9a346de53fd7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1225195 May 25 15:40:46.490362 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:40:46.496132 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e2e41c1d-88e3-4592-943f-311b1745a3f5 req-8b22db97-f952-4bc8-9c2c-1450638cc2ab tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469301 May 25 15:40:46.516037 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 07e4e701-ccf8-451e-b3d9-a809a6936fed) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:46.525827 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27496ccf-e547-4000-a79a-632b21a5b4bc None None] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:46.537660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:46.538210 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.558907 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1c4690fa-0276-4d0b-9569-fbb84147c513 req-f86f309f-df3f-402c-ae47-edb90448e2fe tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571830 May 25 15:40:46.565736 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.7763450 May 25 15:40:46.568651 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41288) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:46.573938 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:46.578547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:46.582480 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Usage tracker for resource:router and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:46.585298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:46.590932 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:46.602097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.603185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.619229 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.767480 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1547634d-df43-43c8-aecd-92d402c51734 req-e1661150-04a6-4d3e-a3b8-4367c51ede5c service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1361055 May 25 15:40:46.803515 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-07e4e701-ccf8-451e-b3d9-a809a6936fed', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:40:46.804567 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.910276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:46.995108 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Allocated IP 172.20.0.2 (07e4e701-ccf8-451e-b3d9-a809a6936fed/79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc/1a98a506-bb9a-4cab-849a-a0e636779c50) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:47.227986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 req-ffba0c78-7bb6-476d-a5b6-564444019e5d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:47.229412 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 req-ffba0c78-7bb6-476d-a5b6-564444019e5d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.0845737 May 25 15:40:47.248889 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.256383 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.265777 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Transition to ACTIVE for port object 1a98a506-bb9a-4cab-849a-a0e636779c50 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:47.290930 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-55fec168-5c48-4bf0-9f6f-3f2ec1a2d963 req-8b06c022-639e-4937-9c6a-fdf464b3897f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533347 May 25 15:40:47.291979 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.299784 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Transition to ACTIVE for port object 1a98a506-bb9a-4cab-849a-a0e636779c50 will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:47.306562 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.312256 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.371511 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:47.374665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:47.379120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:47.423525 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Pushing event updated for resources: {'Port': ['ID=1a98a506-bb9a-4cab-849a-a0e636779c50,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:47.454402 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.476208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Allocated IP 172.27.0.233 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/e99ce846-c3ba-4eab-9642-875905d174be) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:47.481221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Attempting to bind port 1a98a506-bb9a-4cab-849a-a0e636779c50 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:47.481601 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Attempting to bind port 1a98a506-bb9a-4cab-849a-a0e636779c50 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:47.481969 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Attempting to bind port 1a98a506-bb9a-4cab-849a-a0e636779c50 on network 07e4e701-ccf8-451e-b3d9-a809a6936fed {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:47.487286 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:47.487663 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Checking segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:47.488102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.488768 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Bound using segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:47.488946 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Bound port: 1a98a506-bb9a-4cab-849a-a0e636779c50, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:47.489329 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.589511 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] For port 1a98a506-bb9a-4cab-849a-a0e636779c50, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:47.592979 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] For port 1a98a506-bb9a-4cab-849a-a0e636779c50, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=1a98a506-bb9a-4cab-849a-a0e636779c50,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:47.601108 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.614368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.758611 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Pushing event updated for resources: {'Port': ['ID=1a98a506-bb9a-4cab-849a-a0e636779c50,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:47.766538 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:47.790391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-551b3b00-c087-479c-b7fd-b690c3736f66 req-67d87987-0b75-430c-b141-21c232a3ce8b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:47.798104 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-551b3b00-c087-479c-b7fd-b690c3736f66 req-67d87987-0b75-430c-b141-21c232a3ce8b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1052306 May 25 15:40:47.814063 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.852615 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-551b3b00-c087-479c-b7fd-b690c3736f66 req-6abe82d8-ad6e-47f4-911f-4639574459df tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532706 May 25 15:40:47.918051 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:47.928713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:47.974149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 req-b002b851-e20b-4cac-b8ef-67a0fd57518b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:47.980412 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 req-b002b851-e20b-4cac-b8ef-67a0fd57518b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 945 time: 0.1550162 May 25 15:40:48.073828 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:48.084469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:48.092343 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:48.122541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Pushing event updated for resources: {'Port': ['ID=e99ce846-c3ba-4eab-9642-875905d174be,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:48.138606 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:48.150645 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5a94664a-21a7-49ec-bbe3-f32d6e7ea055 req-57adb669-76b8-4e44-b010-43205212f5e7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225438 May 25 15:40:48.536635 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:40:48.595298 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 58598550-b0ed-4b7c-a4d8-2e58f345261c up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:48.661646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 req-639a4dc8-1460-459e-a61e-a93152792974 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:48.670156 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 req-639a4dc8-1460-459e-a61e-a93152792974 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.1553071 May 25 15:40:48.715847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:48.733838 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9b42d1be-10b9-4d5a-af85-a5d48b95b952 req-85e406fd-1369-41f0-b134-35c0ccaa1832 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0623181 May 25 15:40:48.768334 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 58598550-b0ed-4b7c-a4d8-2e58f345261c completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:48.782679 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 58598550-b0ed-4b7c-a4d8-2e58f345261c triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:48.783052 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:48.876583 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41364) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:48.886397 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:48.907205 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:40:49.041935 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.061900 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:40:49.078825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:49.085902 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.096026 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.101614 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.176112 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.198065 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ffec2d22-f4b3-46aa-bc3b-75899fb9fe45 None None] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:40:49.235707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:49.249456 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Usage tracker for resource:security_group_rule and tenant:2e48f398cbab4d54a822459cc1ad336b is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:49.253504 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:49.270044 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:49.427480 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 1a98a506-bb9a-4cab-849a-a0e636779c50 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:49.464876 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.478374 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 req-f5454736-e7af-4c31-8e19-8325975f5b4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:49.480201 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 req-f5454736-e7af-4c31-8e19-8325975f5b4b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 945 time: 0.1314087 May 25 15:40:49.481580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.506914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.514347 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:49.514536 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1494680b-17a5-4b9f-b1a9-5465f539b195 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.516136 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:49.524075 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=2e48f398cbab4d54a822459cc1ad336b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6463156 May 25 15:40:49.526820 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41398) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:49.527005 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.420s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.554954 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:49.562037 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.563109 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:49.640646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c533f59-5af0-4017-8645-02bb66f851d4,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:49.648178 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.653633 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7f6d77ed-5e10-4d3a-933c-8945e9aae3a1 req-d5b0f78d-61cb-4337-b3a7-ce86e0fb8af2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1402216 May 25 15:40:49.654401 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.696246 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.716118 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.754797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['3f734a1c-be04-4203-b351-6b0b6785f9ae'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:40:49.775485 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.776102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0dce8c-7c34-4dd9-bfee-3326597989ca req-1a972abc-6e81-470b-94ed-e38e83432484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:49.781062 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9707cc7f-98ff-4ed0-8505-00e4403093ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:49.783081 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3a0dce8c-7c34-4dd9-bfee-3326597989ca req-1a972abc-6e81-470b-94ed-e38e83432484 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.6449838 May 25 15:40:49.820924 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-160cfbad-7a81-44c0-8b24-6a685b3430ac None None] Provisioning for port 1a98a506-bb9a-4cab-849a-a0e636779c50 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:49.826621 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c533f59-5af0-4017-8645-02bb66f851d4,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:49.833968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:49.851706 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/5c533f59-5af0-4017-8645-02bb66f851d4 HTTP/1.1" status: 204 len: 168 time: 0.3012729 May 25 15:40:49.855016 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:49.863736 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3a0dce8c-7c34-4dd9-bfee-3326597989ca req-eaf2ceb5-d442-4da5-b84b-ae3c42beec3d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0731022 May 25 15:40:49.892504 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c', 'code': 200} May 25 15:40:49.894769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Router 39dd6c05-7a84-4acc-a23b-40de52e09655 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:40:50.097713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d req-e38055af-1d7a-4e2b-bc85-15f09bfb5a4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:50.099228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d req-e38055af-1d7a-4e2b-bc85-15f09bfb5a4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 944 time: 0.1880918 May 25 15:40:50.136315 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b92f43-6b6b-4ef9-b9f9-7b1a2aee2c6c req-16652f5d-3abb-404a-8b78-8a611fc3fc33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:50.137865 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a8b92f43-6b6b-4ef9-b9f9-7b1a2aee2c6c req-16652f5d-3abb-404a-8b78-8a611fc3fc33 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1099 time: 0.1256902 May 25 15:40:50.149200 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:50.167368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:50.167749 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.175240 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fbfec00c-fced-4a4a-84a9-70dca4f7b65d req-4afe9aac-c9ed-45d8-8429-9079d9824b48 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671141 May 25 15:40:50.200987 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a8b92f43-6b6b-4ef9-b9f9-7b1a2aee2c6c req-d4feb882-dbf6-48cd-9be1-6a9baf9c308e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447910 May 25 15:40:50.209156 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 1a98a506-bb9a-4cab-849a-a0e636779c50 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:50.232681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:50.240757 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:50.245299 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Sync routers for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:50.249869 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.534s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:50.255418 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 1a98a506-bb9a-4cab-849a-a0e636779c50 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:50.255788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.256550 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:50.257237 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:50.265532 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.267179 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 3.6974986 May 25 15:40:50.270732 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41416) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:50.404034 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41422) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:50.439775 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.486525 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:50.496417 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Usage tracker for resource:security_group_rule and tenant:cf71cff69f4f4e88926b021ad9e706ef is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:50.501635 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:50.514894 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:50.544899 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:50.604091 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.668107 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:50.670286 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.685249 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.686120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:50.718716 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.723920 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.732856 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.761262 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f287bd59-0f5e-4ac4-b061-639146d092fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.815736 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:50.822043 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:50.856877 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 1a98a506-bb9a-4cab-849a-a0e636779c50, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=1a98a506-bb9a-4cab-849a-a0e636779c50,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:50.865854 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-1d869409-8aab-43e8-ab3d-0331105a6827 None None] Provisioning complete for port 1a98a506-bb9a-4cab-849a-a0e636779c50 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:50.866227 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1d869409-8aab-43e8-ab3d-0331105a6827 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.917681 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:50.922809 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:50.936497 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=cf71cff69f4f4e88926b021ad9e706ef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5309343 May 25 15:40:50.939439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8188e47b-82e5-4fec-aa4e-8960d5a3a500,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:50.942023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41442) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:50.964929 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.965411 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.965671 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.966025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.966450 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.966808 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.967157 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.967507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.967853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.968233 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.968573 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.968916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:50.977718 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.217s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.004826 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:51.012003 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:51.012431 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.023194 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e26605-696a-4a3c-aa55-91c5edf35484 req-14f5bb36-45e7-40f7-ae69-7186340ce00f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:51.024744 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-60e26605-696a-4a3c-aa55-91c5edf35484 req-14f5bb36-45e7-40f7-ae69-7186340ce00f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2289360 May 25 15:40:51.077646 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.094900 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-60e26605-696a-4a3c-aa55-91c5edf35484 req-74582902-b1b8-41ce-a533-1fa2bc058f2f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590796 May 25 15:40:51.132795 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.146197 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=1a98a506-bb9a-4cab-849a-a0e636779c50,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:51.157283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.194963 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:48Z', 'revision_number': 3, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:47Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:51.199097 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Checking router: 39dd6c05-7a84-4acc-a23b-40de52e09655 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:51.199460 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Updating router 39dd6c05-7a84-4acc-a23b-40de52e09655 port e99ce846-c3ba-4eab-9642-875905d174be binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:51.239424 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.251415 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:51.264855 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.308524 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8188e47b-82e5-4fec-aa4e-8960d5a3a500,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:51.322297 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.324192 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.353882 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.360876 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/8188e47b-82e5-4fec-aa4e-8960d5a3a500 HTTP/1.1" status: 204 len: 168 time: 0.3958814 May 25 15:40:51.431315 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:51.441996 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:51.444186 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:51.615731 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:51.619045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:51.625352 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41464) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:51.693951 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a req-fa53b4ec-96d1-4e67-af11-3425ed09d68c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:51.705274 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a req-fa53b4ec-96d1-4e67-af11-3425ed09d68c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.5457866 May 25 15:40:51.723317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 req-dbc0729b-bc4e-42bf-83e5-c0c76a997097 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:51.724983 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 req-dbc0729b-bc4e-42bf-83e5-c0c76a997097 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.2282243 May 25 15:40:51.829352 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e6f3d31c-e45c-4cc2-a47d-88bcf6b60129 req-9315eb69-d3bb-4dd1-936a-2724d462cabe tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0970173 May 25 15:40:51.893558 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'}, {'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:51.934998 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b56a65a5-94bd-4acb-abc0-87bd696a1f8a req-28e4d6ed-b104-4698-b8c6-01e31e96fadd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2287984 May 25 15:40:51.973840 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc', 'code': 200} May 25 15:40:51.974748 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'code': 200} May 25 15:40:51.981388 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.007521 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Transition to ACTIVE for port object e99ce846-c3ba-4eab-9642-875905d174be will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:52.027543 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.034876 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-3d622d51-b31e-4174-86a7-f3e7ae100627 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.062705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.120876 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.162512 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:52.167733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Usage tracker for resource:security_group_rule and tenant:b72959aad16248e6ae1ea886204d950a is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:52.173617 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:52.187541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:52.203497 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Attempting to bind port e99ce846-c3ba-4eab-9642-875905d174be on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:52.204411 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Attempting to bind port e99ce846-c3ba-4eab-9642-875905d174be by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:52.204990 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Attempting to bind port e99ce846-c3ba-4eab-9642-875905d174be on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:52.214671 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:52.215335 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:52.215999 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.216584 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:52.217277 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Bound port: e99ce846-c3ba-4eab-9642-875905d174be, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:52.217885 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.318373 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] For port e99ce846-c3ba-4eab-9642-875905d174be, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:52.324694 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] For port e99ce846-c3ba-4eab-9642-875905d174be, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e99ce846-c3ba-4eab-9642-875905d174be,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:52.329338 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f800ebf-214c-4a5e-9a4b-614bb1db4ec0 None None] Pushing event updated for resources: {'Port': ['ID=e99ce846-c3ba-4eab-9642-875905d174be,revision_number=2']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:52.333667 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-5f800ebf-214c-4a5e-9a4b-614bb1db4ec0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.338433 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.346009 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.412788 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41496) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:52.425979 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:52.426738 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:52.447219 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.453303 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.489075 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f800ebf-214c-4a5e-9a4b-614bb1db4ec0 None None] Pushing event updated for resources: {'Port': ['ID=e99ce846-c3ba-4eab-9642-875905d174be,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:52.490216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.499963 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-5f800ebf-214c-4a5e-9a4b-614bb1db4ec0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.500351 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=b72959aad16248e6ae1ea886204d950a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8715682 May 25 15:40:52.503178 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41502) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:52.541102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:52.549026 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b77e734-76e8-46f0-bb32-22193eb60964,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:52.554830 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.626200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.663266 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:52.684691 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.685214 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 3f734a1c-be04-4203-b351-6b0b6785f9ae completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:52.690650 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 3f734a1c-be04-4203-b351-6b0b6785f9ae triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:52.691024 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.785521 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Allocated IP 172.20.0.1 (07e4e701-ccf8-451e-b3d9-a809a6936fed/79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc/85083215-6cfc-4d24-9e98-c780cae18089) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:40:52.786229 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.791094 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-99ed7a0f-f02c-422a-87b8-cb92d339b616 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:52.797069 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.810625 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b77e734-76e8-46f0-bb32-22193eb60964,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:52.823839 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:52.828210 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.829337 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/2b77e734-76e8-46f0-bb32-22193eb60964 HTTP/1.1" status: 204 len: 168 time: 0.3250806 May 25 15:40:52.847312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:52.909607 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.934024 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Usage tracker for resource:security_group_rule and tenant:bb92e9096f364372965681a474623ea5 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:52.947648 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:52.982478 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:52.994316 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:52.996934 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.000021 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:53.005550 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f59ee51e-c3b5-447b-9a4d-1291a07293a7 req-2707b7c7-1ec9-4fe3-bb90-5f3c8071a4fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:53.007613 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f59ee51e-c3b5-447b-9a4d-1291a07293a7 req-2707b7c7-1ec9-4fe3-bb90-5f3c8071a4fe service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.4979470 May 25 15:40:53.021109 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff5681d-5220-4311-887d-7678bcb2ac0a req-d9b2f0fe-c345-46d6-a2bf-fa6bcf1be49b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:53.023348 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7ff5681d-5220-4311-887d-7678bcb2ac0a req-d9b2f0fe-c345-46d6-a2bf-fa6bcf1be49b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.7243052 May 25 15:40:53.030728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354f8222-58b1-421c-8b06-cc2caa7e5896 req-2468c08b-7770-4763-a1e9-1867db3952ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:53.032383 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-354f8222-58b1-421c-8b06-cc2caa7e5896 req-2468c08b-7770-4763-a1e9-1867db3952ec service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.5217469 May 25 15:40:53.132374 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f59ee51e-c3b5-447b-9a4d-1291a07293a7 req-f137e9a7-77cb-4665-ae07-3cc6c60bc1f2 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1056559 May 25 15:40:53.160541 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7ff5681d-5220-4311-887d-7678bcb2ac0a req-0a90d6bb-d853-46e5-83b5-c72db4852553 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1246250 May 25 15:40:53.195167 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:53.204961 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.206342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.206995 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.207629 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.210273 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.210763 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.211699 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.212251 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.212768 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.213371 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.214237 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-354f8222-58b1-421c-8b06-cc2caa7e5896 req-d14f3d23-9c1e-4f34-abdc-7e22f33d18c6 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0994322 May 25 15:40:53.214537 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.215003 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.219514 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.240139 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 1a98a506-bb9a-4cab-849a-a0e636779c50 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:53.293783 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c277868a-91b6-40a5-8d1c-316b5c38056b req-79175cfd-f49f-4d7f-93a2-44dee9c2a7b6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:53.295390 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c277868a-91b6-40a5-8d1c-316b5c38056b req-79175cfd-f49f-4d7f-93a2-44dee9c2a7b6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1950665 May 25 15:40:53.317959 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.355325 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:48Z', 'revision_number': 3, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:53.363093 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7172fe82-62ed-4f3c-91b9-793a5e3d4f51 None None] The sync data for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi is: [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:48Z', 'revision_number': 3, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:40:53.372788 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Transition to ACTIVE for port object 85083215-6cfc-4d24-9e98-c780cae18089 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:53.387122 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 1a98a506-bb9a-4cab-849a-a0e636779c50 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:53.387512 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.403390 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c277868a-91b6-40a5-8d1c-316b5c38056b req-96fb1416-4032-4719-b33c-f5b7b6be3767 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0989568 May 25 15:40:53.560862 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.573913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.615017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.633488 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=bb92e9096f364372965681a474623ea5&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1468227 May 25 15:40:53.634784 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41546) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:53.681217 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8be0f14-9d34-4831-bd97-6e7736ed1943 req-dfe8dc81-3f0b-42f4-9367-0cfe2477d48a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:53.682779 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8be0f14-9d34-4831-bd97-6e7736ed1943 req-dfe8dc81-3f0b-42f4-9367-0cfe2477d48a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2098761 May 25 15:40:53.683456 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=383c5284-7167-477f-a864-1f718d0dc129,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:53.688132 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.704528 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.704878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.705228 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.706113 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.706449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.706921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.707259 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.707594 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.707960 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.708292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.708618 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.708941 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:40:53.724777 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:53.745871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:53.785301 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.806751 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:53.826568 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.965058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:53.967986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:40:53.977210 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:40:53.981298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:53.993983 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-fa6791c8-6d30-4c2f-9ec6-b3583fd0b4b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:54.009648 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=383c5284-7167-477f-a864-1f718d0dc129,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:54.016729 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:54.020722 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:54.021887 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/383c5284-7167-477f-a864-1f718d0dc129 HTTP/1.1" status: 204 len: 168 time: 0.3859639 May 25 15:40:54.114528 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8be0f14-9d34-4831-bd97-6e7736ed1943 req-d589e76d-f55c-4c8e-9fc5-27e4ccec8948 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4216623 May 25 15:40:54.208155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Pushing event updated for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:54.219941 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.474s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:54.223430 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'code': 200} May 25 15:40:54.237418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:54.312250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a607999b-6f11-4416-a027-e05a9811da9a req-ef12d888-11fa-4124-b84a-aaceca645eda tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:54.323016 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a607999b-6f11-4416-a027-e05a9811da9a req-ef12d888-11fa-4124-b84a-aaceca645eda tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2484338 May 25 15:40:54.426532 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-9657be1d-857f-4c07-a214-e8e5736739af None None] Provisioning for port 85083215-6cfc-4d24-9e98-c780cae18089 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:54.434405 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-9657be1d-857f-4c07-a214-e8e5736739af None None] Provisioning complete for port 85083215-6cfc-4d24-9e98-c780cae18089 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:54.434990 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9657be1d-857f-4c07-a214-e8e5736739af None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:54.441427 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a607999b-6f11-4416-a027-e05a9811da9a req-4d9503b8-1d74-4235-a7e7-caee26b25023 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1174397 May 25 15:40:54.488671 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-c3dc916e-e02f-4071-9993-944e5cf66a5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:54.490590 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-c3dc916e-e02f-4071-9993-944e5cf66a5d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1099 time: 0.4820156 May 25 15:40:54.497302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:54.579505 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-9657be1d-857f-4c07-a214-e8e5736739af None None] Port 85083215-6cfc-4d24-9e98-c780cae18089 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:54.939686 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41584) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:54.966216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:54.982709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:54.986918 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Usage tracker for resource:security_group_rule and tenant:79db9854aece494191ee906f83fbb5fa is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:54.990049 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:55.007789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:55.013371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 req-cd3ab4f1-54ad-41c9-9c0d-bf136277338a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:55.015377 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 req-cd3ab4f1-54ad-41c9-9c0d-bf136277338a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.4001567 May 25 15:40:55.016723 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-b76455ce-bb05-495b-a127-6dd45a6805f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:55.018864 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-b76455ce-bb05-495b-a127-6dd45a6805f4 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.4940977 May 25 15:40:55.150840 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.160993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.168961 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-5749b227-c81b-4064-9f3c-2757afb5a060 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c HTTP/1.1" status: 200 len: 217 time: 0.0847669 May 25 15:40:55.197058 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-01ba53f5-1154-4ef6-b67a-7d15f43bee04 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.198736 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d004880-ad62-4a85-90f8-15b08ba6013e req-a5cc1f59-00e3-4787-946c-dcc31801e3ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:55.200401 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5d004880-ad62-4a85-90f8-15b08ba6013e req-a5cc1f59-00e3-4787-946c-dcc31801e3ee service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1099 time: 0.6773422 May 25 15:40:55.210441 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=79db9854aece494191ee906f83fbb5fa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2691183 May 25 15:40:55.220241 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41602) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:55.275577 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e99ce846-c3ba-4eab-9642-875905d174be up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:55.284763 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ae9f88b-a1c1-4d65-9dcb-54b516ea658a,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:55.288294 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.390873 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.402134 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5d004880-ad62-4a85-90f8-15b08ba6013e req-0d47f039-b446-4e84-a055-71b70a768a14 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1439807 May 25 15:40:55.434508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-eba7109a-c6bb-492d-ba60-964081016983 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:55.436186 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-eba7109a-c6bb-492d-ba60-964081016983 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.2329972 May 25 15:40:55.450922 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1b6e6b4-903f-4ea1-a2cc-7ecbcf50c518 req-40c72887-d8dd-4388-92cd-8b34dc771045 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3644361 May 25 15:40:55.524406 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port e99ce846-c3ba-4eab-9642-875905d174be completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:40:55.531241 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e99ce846-c3ba-4eab-9642-875905d174be triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:55.532252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.534918 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.545469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.545711 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.632805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ebf-201f-4748-ac89-80840df462c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.686130 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.710930 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port e99ce846-c3ba-4eab-9642-875905d174be, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e99ce846-c3ba-4eab-9642-875905d174be,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:40:55.717135 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.721010 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.737843 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff2730e-8790-4d76-9fd8-027cbb90a564 req-949b4f0b-6e6d-47d1-91ca-14e2835c2cc5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:55.739423 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7ff2730e-8790-4d76-9fd8-027cbb90a564 req-949b4f0b-6e6d-47d1-91ca-14e2835c2cc5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.3287685 May 25 15:40:55.783132 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.808140 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-026e456b-cc84-463e-b53b-36f9120c3951 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:55.848609 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-1036a39c-3ddb-4ac0-b3b1-c2f29417dbb2 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2353942 May 25 15:40:55.855113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ae9f88b-a1c1-4d65-9dcb-54b516ea658a,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:55.872390 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.875697 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=e99ce846-c3ba-4eab-9642-875905d174be,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:55.884229 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:55.887567 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/2ae9f88b-a1c1-4d65-9dcb-54b516ea658a HTTP/1.1" status: 204 len: 168 time: 0.6595056 May 25 15:40:55.887708 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:55.928035 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7ff2730e-8790-4d76-9fd8-027cbb90a564 req-5f944086-0367-4e11-9fe0-fb42d088f812 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1818178 May 25 15:40:55.965761 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Pushing event updated for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:55.981155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.355s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:56.035521 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:56.259871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:40:56.271078 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7940017d-4586-4d5e-a2ec-563f4fd62d19 req-fd985c63-056c-4e6b-ab4e-26fc2a74324c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:56.273651 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7940017d-4586-4d5e-a2ec-563f4fd62d19 req-fd985c63-056c-4e6b-ab4e-26fc2a74324c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.5807345 May 25 15:40:56.276131 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-cc807a23-99f1-4245-b5fb-1348a768a7cb service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4015000 May 25 15:40:56.277303 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:40:56.711203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 req-3c8c6266-89d1-4b76-ae9e-aaf7de429948 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:56.712608 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 req-3c8c6266-89d1-4b76-ae9e-aaf7de429948 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1055911 May 25 15:40:56.732814 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-fc214db9-3b08-4e9b-8351-a136b7e83163 None None] Provisioning complete for port 85083215-6cfc-4d24-9e98-c780cae18089 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:56.733339 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-fc214db9-3b08-4e9b-8351-a136b7e83163 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:56.783943 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c0c2cf5b-ee7c-4612-a87b-8a41f49633a1 req-ef37c98f-bbc5-4b72-979b-623569048978 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644240 May 25 15:40:56.784110 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7940017d-4586-4d5e-a2ec-563f4fd62d19 req-c65cf879-5220-4204-8625-e93f7d257c79 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4861648 May 25 15:40:56.806503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-fc214db9-3b08-4e9b-8351-a136b7e83163 None None] Port 85083215-6cfc-4d24-9e98-c780cae18089 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:40:56.945867 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bdc9454a-c058-4765-af23-b2cfb2f737c9 req-5b2c1eed-b281-46c1-ba0f-c96554dd6dee service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4186263 May 25 15:40:56.962178 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Router 39dd6c05-7a84-4acc-a23b-40de52e09655 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:40:57.013872 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 req-0ff27e8b-5669-4f87-811b-16561a50117d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:57.028308 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-17a7b083-72d8-4b6e-9643-72e6b8f69a80 req-0ff27e8b-5669-4f87-811b-16561a50117d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1078985 May 25 15:40:57.029752 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41688) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:57.044041 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'floatingip': {'port_id': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:57.215415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e99ce846-c3ba-4eab-9642-875905d174be up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:40:57.246666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:57.333421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port e99ce846-c3ba-4eab-9642-875905d174be triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:40:57.333803 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:57.443369 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:57.457448 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Sync routers for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:57.471447 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:57.472848 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:57.530760 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40baa53e-e524-436b-a2c6-cb4338fe0999 req-01035dd7-13d5-437a-a3d6-a0ce24d458c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:57.546543 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-40baa53e-e524-436b-a2c6-cb4338fe0999 req-01035dd7-13d5-437a-a3d6-a0ce24d458c5 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2614539 May 25 15:40:57.640883 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] 10.222.0.36 "PUT /v2.0/routers/39dd6c05-7a84-4acc-a23b-40de52e09655/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.3685856 May 25 15:40:57.662139 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-40baa53e-e524-436b-a2c6-cb4338fe0999 req-7e8955c5-0cd6-48c7-9bc2-eb93c0c22c44 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146328 May 25 15:40:57.842950 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:58.106576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f req-cefe0ded-9d00-485c-a659-887788463475 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:58.114992 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f req-cefe0ded-9d00-485c-a659-887788463475 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1230142 May 25 15:40:58.192151 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f2ff7d0c-9c24-448a-9b12-1e2f9c33518f req-0b336f3e-c68b-437f-8363-d7103b56e4bb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737174 May 25 15:40:58.338455 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 2, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:58.342823 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Checking router: 39dd6c05-7a84-4acc-a23b-40de52e09655 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:40:58.343276 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Updating router 39dd6c05-7a84-4acc-a23b-40de52e09655 port 85083215-6cfc-4d24-9e98-c780cae18089 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:40:58.362484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55aa8236-d9f5-4129-a2b5-466039ab9c57 req-e525be28-7a4a-454d-9bed-86f5c83b9010 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:58.363417 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-55aa8236-d9f5-4129-a2b5-466039ab9c57 req-e525be28-7a4a-454d-9bed-86f5c83b9010 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.6126997 May 25 15:40:58.406430 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.455326 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-55aa8236-d9f5-4129-a2b5-466039ab9c57 req-b7434eac-c5a5-493b-a64c-7d00f7dea519 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0771272 May 25 15:40:58.601771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41752) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:58.650960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.657502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.764866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.802073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:58.806470 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Usage tracker for resource:security_group_rule and tenant:acd2b0dfe8d044d48d8eeff27836ca08 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:58.809473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:58.815617 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:58.838498 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.865157 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41764) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:58.867609 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Transition to ACTIVE for port object 85083215-6cfc-4d24-9e98-c780cae18089 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:40:58.872557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1881276553-network', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:58.884989 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:58.891016 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:58.915545 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Floating IP 6016d7d3-3093-4cb9-aacb-3a642caf656e associated. External IP: 172.27.0.200, port: cfbb7459-c8f7-4441-8886-be2a6b4ad1a7. May 25 15:40:58.927499 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:58.962921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Usage tracker for resource:network and tenant:0ac68a1aab024cc6bdafb482b8270253 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:58.970124 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:58.990448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:58.994866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.009146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.024320 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c81892a5-b6ba-460a-b399-9941a95d5896 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.041709 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Made reservation on behalf of 0ac68a1aab024cc6bdafb482b8270253 for: {'network': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:59.044197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.075177 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.114613 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=acd2b0dfe8d044d48d8eeff27836ca08&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5116770 May 25 15:40:59.118881 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Pushing event updated for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.122110 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.123388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb153c13-70e1-4031-bc7d-d0f5e070275a req-945694d1-c36d-49ee-b8e7-dea480e7b20f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:59.125027 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb153c13-70e1-4031-bc7d-d0f5e070275a req-945694d1-c36d-49ee-b8e7-dea480e7b20f tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2607229 May 25 15:40:59.125637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41768) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:59.131256 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:59.132600 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Attempting to bind port 85083215-6cfc-4d24-9e98-c780cae18089 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:40:59.133049 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Attempting to bind port 85083215-6cfc-4d24-9e98-c780cae18089 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:40:59.133335 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Attempting to bind port 85083215-6cfc-4d24-9e98-c780cae18089 on network 07e4e701-ccf8-451e-b3d9-a809a6936fed {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:40:59.134743 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebf9ff89-b18c-49b5-a9ae-56f976d3b235,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.140707 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 40, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:40:59.141094 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Checking segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:40:59.141500 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.141895 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Bound using segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:40:59.142374 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Bound port: 85083215-6cfc-4d24-9e98-c780cae18089, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:40:59.142764 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.155771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Usage tracker for resource:security_group_rule and tenant:0ac68a1aab024cc6bdafb482b8270253 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:59.159509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.161915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:59.187349 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:59.281031 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] For port 85083215-6cfc-4d24-9e98-c780cae18089, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:40:59.285329 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] For port 85083215-6cfc-4d24-9e98-c780cae18089, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=85083215-6cfc-4d24-9e98-c780cae18089,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:40:59.290730 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.301855 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.374471 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb153c13-70e1-4031-bc7d-d0f5e070275a req-71055c01-c599-4cfa-9835-e6577f2de8b8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2200887 May 25 15:40:59.383274 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.389647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.392677 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:59.394124 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:40:59.395502 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.429635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.440631 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.473325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 369} {{(pid=98462) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:40:59.504449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7e57058-6c07-453f-acb9-391d28ee58f0,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.510018 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.511261 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8752734249445', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.511811 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Unsubscribe: segment precommit_create {{(pid=98462) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 15:40:59.512263 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.segments_db [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Added segment cbe9aa6f-59e5-4d9c-a49a-dcb74262e698 of type vlan for network 0d36140b-a597-4dfb-a417-ad474e1f632f May 25 15:40:59.524385 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Pushing event updated for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.531121 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.548958 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.584551 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.588751 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.589649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:40:59.621719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd req-a5fe94c1-797f-4164-9c5a-765253c0878e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:59.622220 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebf9ff89-b18c-49b5-a9ae-56f976d3b235,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.628896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.631559 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd req-a5fe94c1-797f-4164-9c5a-765253c0878e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2750020 May 25 15:40:59.635273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.639290 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:59.639920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.649625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6856c83c-d595-41f3-b4a1-415a543ab1f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:40:59.759977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:40:59.760345 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f6ca9a2e-f200-49b0-bdcb-7b56c04a0ecd req-ff9ab661-e1d0-4564-ae2b-74cfaf816060 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274481 May 25 15:40:59.823628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.827396 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/ebf9ff89-b18c-49b5-a9ae-56f976d3b235 HTTP/1.1" status: 204 len: 168 time: 0.6981864 May 25 15:40:59.843608 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9748609 May 25 15:40:59.843608 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Pushing event updated for resources: {'Network': ['ID=0d36140b-a597-4dfb-a417-ad474e1f632f,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:40:59.845241 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41780) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:40:59.848696 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:40:59.859235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Request body: {'subnet': {'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1881276553-subnet', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:40:59.867324 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:40:59.872663 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Usage tracker for resource:subnet and tenant:0ac68a1aab024cc6bdafb482b8270253 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:40:59.876854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:40:59.885987 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:40:59.905974 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Made reservation on behalf of 0ac68a1aab024cc6bdafb482b8270253 for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:40:59.908341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10881158'] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.920107 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 0d36140b-a597-4dfb-a417-ad474e1f632f details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:40:59.926978 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:40:59.941753 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:40:59.942504 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:40:59.945647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00451b12-d5ef-46da-9789-b8597ef26302 req-694bf2dd-5462-48be-9419-ab3f3f26b260 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:40:59.947727 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-00451b12-d5ef-46da-9789-b8597ef26302 req-694bf2dd-5462-48be-9419-ab3f3f26b260 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2639377 May 25 15:40:59.961024 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:40:59.961662 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:00.015967 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-cbca4d3c-2a82-44f8-81e6-42a947dd60a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "PUT /v2.0/floatingips/6016d7d3-3093-4cb9-aacb-3a642caf656e HTTP/1.1" status: 200 len: 991 time: 2.9835372 May 25 15:41:00.016948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:00.184910 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-00451b12-d5ef-46da-9789-b8597ef26302 req-df446b1d-c310-46f7-8858-31b3228053d2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2303114 May 25 15:41:00.225437 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-bb2558c3-9e65-4d00-8f4f-95c4d85a1b26 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.263001 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:00.324347 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'status': 'completed', 'code': 200} May 25 15:41:00.432701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:40:59Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:00.442811 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7217a8d5-c1c5-4075-a73e-453736f57502 None None] The sync data for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi is: [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:40:59Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:00.457438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41798) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:00.480814 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.509772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:00.517510 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Usage tracker for resource:security_group_rule and tenant:4b1039a2af704e5faae068094638c93e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:00.521926 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:00.536787 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:00.657821 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c6408e6-87fb-4fb8-88bb-a58953c89462 req-31f58ce9-7fc0-44a9-9eae-241e26c1033c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:00.663342 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6c6408e6-87fb-4fb8-88bb-a58953c89462 req-31f58ce9-7fc0-44a9-9eae-241e26c1033c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.1764293 May 25 15:41:00.670086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41802) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:00.677292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'floatingip': {'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:00.697856 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.705992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.713469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f9b0e16-16a1-4611-baec-adaac5188aa2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:00.802282 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=4b1039a2af704e5faae068094638c93e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3433466 May 25 15:41:00.803156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41808) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:00.803731 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ca6235a-94c0-430b-9ab5-01a59b46da8b,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:00.807413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.808880 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:00.833239 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6016d7d3-3093-4cb9-aacb-3a642caf656e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.200', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:1b:62:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:08Z', 'updated_at': '2021-05-25T15:40:58Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:00.843681 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:00.854514 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:00.857120 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:40:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:00.891738 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:00.951844 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.037380 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.041116 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:01.053974 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1633497', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10881168'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.057756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ca6235a-94c0-430b-9ab5-01a59b46da8b,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:01.066831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:01.072495 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.073719 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/0ca6235a-94c0-430b-9ab5-01a59b46da8b HTTP/1.1" status: 204 len: 168 time: 0.2664640 May 25 15:41:01.113968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-75545a94-6f38-4d7c-b52c-265dfdb18399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:01.138421 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:01.275032 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 85083215-6cfc-4d24-9e98-c780cae18089 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:01.383171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f8b27a4c-a2b0-40aa-b698-aaf984ec16be,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:01.386579 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 85083215-6cfc-4d24-9e98-c780cae18089 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:01.391786 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 85083215-6cfc-4d24-9e98-c780cae18089 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:01.392198 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.395795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:01.438815 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Checking segment: {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:01.440483 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Network hostable DHCP agents. Network: 0d36140b-a597-4dfb-a417-ad474e1f632f, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:41:01.517276 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c55384-db82-4f21-aff4-eecf11d9e9ca req-38baa7e3-d419-478c-a056-73c2faec7464 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:01.519348 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-98c55384-db82-4f21-aff4-eecf11d9e9ca req-38baa7e3-d419-478c-a056-73c2faec7464 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.5139697 May 25 15:41:01.557835 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.610482 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 85083215-6cfc-4d24-9e98-c780cae18089, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=85083215-6cfc-4d24-9e98-c780cae18089,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:01.621238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.623410 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:01.638533 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Network 0d36140b-a597-4dfb-a417-ad474e1f632f is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:41:01.721408 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:01.728254 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:01.788296 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6016d7d3-3093-4cb9-aacb-3a642caf656e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.200', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:1b:62:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:08Z', 'updated_at': '2021-05-25T15:40:58Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:01.796679 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9626dece-1391-4b5c-ab5f-971527c9a881 None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6016d7d3-3093-4cb9-aacb-3a642caf656e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.200', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 106, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:1b:62:e3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:08Z', 'updated_at': '2021-05-25T15:40:58Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:01.905057 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 0d36140b-a597-4dfb-a417-ad474e1f632f) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:01.918530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdd72c2f-9e24-448e-aaa5-9816f5c09913 None None] Network 0d36140b-a597-4dfb-a417-ad474e1f632f requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:01.920738 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-98c55384-db82-4f21-aff4-eecf11d9e9ca req-33ecf351-58ef-4e4b-a4ab-509698c20720 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3773992 May 25 15:41:01.933632 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:01.934238 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:01.958985 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 2.1115632 May 25 15:41:01.963044 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 41830) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:01.972852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:01.978478 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:01.983334 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Usage tracker for resource:router and tenant:0ac68a1aab024cc6bdafb482b8270253 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:02.001099 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:02.012629 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:02.053758 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.054943 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.176226 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86e0ce4c-d857-45b1-a2ca-401eabf4450b None None] New status for floating IP 6016d7d3-3093-4cb9-aacb-3a642caf656e: ACTIVE {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:41:02.263145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.300596 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.db.resource_extend [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] It took 0.22 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 15:41:02.544306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baad2a0a-f4f0-4876-a96e-911b5a457887 req-3c5e328d-8e1d-48f2-8054-2bcbc4402706 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:02.545844 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-baad2a0a-f4f0-4876-a96e-911b5a457887 req-3c5e328d-8e1d-48f2-8054-2bcbc4402706 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.4262371 May 25 15:41:02.557967 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.586062 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.602546 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-0d36140b-a597-4dfb-a417-ad474e1f632f', 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'fixed_ips': [{'subnet_id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:41:02.603411 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.695973 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.716804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a917b415-02ea-4fc3-93da-389e690d27fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:02.814494 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-baad2a0a-f4f0-4876-a96e-911b5a457887 req-2c367ba8-69ae-46d2-92ee-435fecc4210b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2538657 May 25 15:41:02.856370 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Allocated IP 172.20.0.2 (0d36140b-a597-4dfb-a417-ad474e1f632f/f8b27a4c-a2b0-40aa-b698-aaf984ec16be/8852aea3-f8fb-409c-9034-67272cb22c8c) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:02.888439 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.009740 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Floating IP 4754fbd6-8842-4b6c-b280-b86c8a348c2f associated. External IP: 172.27.0.235, port: 3f734a1c-be04-4203-b351-6b0b6785f9ae. May 25 15:41:03.101603 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.114450 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Transition to ACTIVE for port object 8852aea3-f8fb-409c-9034-67272cb22c8c will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:03.140575 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Transition to ACTIVE for port object 8852aea3-f8fb-409c-9034-67272cb22c8c will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:03.147570 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.167155 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:03.213056 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 85083215-6cfc-4d24-9e98-c780cae18089 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:03.261712 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Network 0d36140b-a597-4dfb-a417-ad474e1f632f is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:03.265108 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:03.285112 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:03.318210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a req-3f9b60e1-dab9-4dbd-941f-112c659f3696 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:03.319692 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a req-3f9b60e1-dab9-4dbd-941f-112c659f3696 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2575281 May 25 15:41:03.380265 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Pushing event updated for resources: {'Port': ['ID=8852aea3-f8fb-409c-9034-67272cb22c8c,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:03.399399 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:03.429903 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Attempting to bind port 8852aea3-f8fb-409c-9034-67272cb22c8c on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:03.430652 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Attempting to bind port 8852aea3-f8fb-409c-9034-67272cb22c8c by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:03.435344 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Attempting to bind port 8852aea3-f8fb-409c-9034-67272cb22c8c on network 0d36140b-a597-4dfb-a417-ad474e1f632f {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:03.445005 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:03.445353 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Checking segment: {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:03.445927 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.446196 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Bound using segment: {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:03.446688 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Bound port: 8852aea3-f8fb-409c-9034-67272cb22c8c, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:03.447067 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.458604 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.468319 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 85083215-6cfc-4d24-9e98-c780cae18089 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:03.468690 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.617872 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] For port 8852aea3-f8fb-409c-9034-67272cb22c8c, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:03.620746 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] For port 8852aea3-f8fb-409c-9034-67272cb22c8c, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8852aea3-f8fb-409c-9034-67272cb22c8c,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:03.654423 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:03.672074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-45b401f4-e24d-4f03-a6fb-aa33c7f98a22 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:03.761137 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Pushing event updated for resources: {'Port': ['ID=8852aea3-f8fb-409c-9034-67272cb22c8c,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:03.764100 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:03.768471 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2d7e2957-4015-4bbf-b2ed-b406d51b9b7a req-7a47cf85-b3f1-4569-8a26-c8e58f28b940 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3777773 May 25 15:41:03.924914 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:41:03.938715 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-a6b28f75-2b6e-45ad-82eb-d208c0f108ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:03.939835 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-a6b28f75-2b6e-45ad-82eb-d208c0f108ea service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.5058093 May 25 15:41:03.952537 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:04.111718 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df6e916-72ec-4a94-af8f-c6d819533d4c req-014d6873-49e0-40e1-8680-dad9b472fbf0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:04.113391 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4df6e916-72ec-4a94-af8f-c6d819533d4c req-014d6873-49e0-40e1-8680-dad9b472fbf0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1477463 May 25 15:41:04.117326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:04.198672 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4df6e916-72ec-4a94-af8f-c6d819533d4c req-1dc9dc2d-41ad-43b5-8fa4-d47a7d91ba34 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780656 May 25 15:41:04.434935 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:04.449663 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:04.460560 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:04.461372 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:04.461774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-2b1d5d71-3049-48e6-98c7-cbeda46804bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:04.463334 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-2b1d5d71-3049-48e6-98c7-cbeda46804bb service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.4054940 May 25 15:41:04.545116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:04.586563 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Allocated IP 172.27.0.242 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:04.771759 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:04.854794 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-3000b236-5bf1-41f3-912f-a6980284031f service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1001 time: 0.3794165 May 25 15:41:04.863283 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f1382fee-703d-4f92-9b92-2f0c96823d31 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "PUT /v2.0/floatingips/4754fbd6-8842-4b6c-b280-b86c8a348c2f HTTP/1.1" status: 200 len: 992 time: 4.1917884 May 25 15:41:04.871397 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:05.029000 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-23fd64d8-bb84-4aab-8120-145361ed6626 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.030474 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-23fd64d8-bb84-4aab-8120-145361ed6626 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.1499288 May 25 15:41:05.069874 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-b948bc24-b2ba-4691-aadd-638148e89a31 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.071385 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-b948bc24-b2ba-4691-aadd-638148e89a31 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.70 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.4664676 May 25 15:41:05.074505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:05.125711 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-591bddf3-eb4f-448c-9049-423cbd3441bb None None] Network 0d36140b-a597-4dfb-a417-ad474e1f632f requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:41:05.185332 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 req-5ff0acdd-d38c-4cde-bc51-9ef6963adf2a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.186891 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 req-5ff0acdd-d38c-4cde-bc51-9ef6963adf2a tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.1854315 May 25 15:41:05.311038 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-469fdb2c-ec6c-4dfb-a871-50a3c5da4b61 req-50abe5c2-cbdb-4460-b6a4-f95d70a9f3a2 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151905 May 25 15:41:05.364424 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'status': 'completed', 'code': 200} May 25 15:41:05.383457 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8852aea3-f8fb-409c-9034-67272cb22c8c up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:05.437137 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-a57befa5-8abc-4c5b-a693-4f1d491064af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.444887 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-a57befa5-8abc-4c5b-a693-4f1d491064af service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3870494 May 25 15:41:05.464381 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:05.483273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:05.493487 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:05.508870 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Provisioning for port 8852aea3-f8fb-409c-9034-67272cb22c8c completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:05.517610 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 8852aea3-f8fb-409c-9034-67272cb22c8c completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:05.537109 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Provisioning complete for port 8852aea3-f8fb-409c-9034-67272cb22c8c triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:05.537909 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:05.585924 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 8852aea3-f8fb-409c-9034-67272cb22c8c triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:05.587021 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:05.587989 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-39fe5832-4f3b-4186-aeff-9384589c68d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.589565 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-39fe5832-4f3b-4186-aeff-9384589c68d4 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1099 time: 0.1846712 May 25 15:41:05.633427 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '4754fbd6-8842-4b6c-b280-b86c8a348c2f', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.235', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:25Z', 'updated_at': '2021-05-25T15:41:02Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:05.645248 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:05.668921 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:05.669568 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:05.889553 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-a7d8332c-812d-45da-9237-2e41e6d92d64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:05.892995 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-a7d8332c-812d-45da-9237-2e41e6d92d64 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.2914481 May 25 15:41:06.004994 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:06.040628 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:06.087339 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] For port 8852aea3-f8fb-409c-9034-67272cb22c8c, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8852aea3-f8fb-409c-9034-67272cb22c8c,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:06.139952 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:06.163120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:06.172045 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Deleting port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:41:06.172045 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:06.178803 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-fa3e0a75-a9a5-4cf2-86de-f69874389c8c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 1000 time: 0.2705262 May 25 15:41:06.204136 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5d3f450-026b-4f7b-9d30-191e85fe188c req-1ea655b4-40ed-4352-b1b7-d8d8082dbfbd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:06.214879 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f5d3f450-026b-4f7b-9d30-191e85fe188c req-1ea655b4-40ed-4352-b1b7-d8d8082dbfbd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2452371 May 25 15:41:06.246650 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:06.284657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:06.285163 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:06.355832 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.db.api [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=98464) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} May 25 15:41:06.356467 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_db.api [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} May 25 15:41:06.365530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Pushing event updated for resources: {'Port': ['ID=8852aea3-f8fb-409c-9034-67272cb22c8c,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:06.369762 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.402840 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:06.424498 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f5d3f450-026b-4f7b-9d30-191e85fe188c req-ec7f8fd8-67f2-47c7-82b1-f9855ea0b18d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2078204 May 25 15:41:06.430306 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-3d3e6627-b7a8-4673-8bc6-251f4a8e9951 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:06.433046 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-3d3e6627-b7a8-4673-8bc6-251f4a8e9951 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.1488612 May 25 15:41:06.489217 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-42bb8456-0ba8-484e-9dd5-8957c2e3844d None None] Provisioning complete for port 8852aea3-f8fb-409c-9034-67272cb22c8c triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:06.490627 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-42bb8456-0ba8-484e-9dd5-8957c2e3844d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:06.708044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 41998) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:06.774236 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Pushing event updated for resources: {'Port': ['ID=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:06.777941 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '4754fbd6-8842-4b6c-b280-b86c8a348c2f', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.235', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:25Z', 'updated_at': '2021-05-25T15:41:02Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:06.783133 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.300s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:06.784915 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dc68116-84db-4de8-9243-8de8799b6525 None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '4754fbd6-8842-4b6c-b280-b86c8a348c2f', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.235', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:40:25Z', 'updated_at': '2021-05-25T15:41:02Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:06.855772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-05f3e817-2e8c-4c5b-a742-1fa8f9d475c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:06.857292 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-05f3e817-2e8c-4c5b-a742-1fa8f9d475c0 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.4096661 May 25 15:41:06.873898 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d6e105b-014d-4451-8d4a-c48c992faa7d req-0e899abc-e836-40fa-961b-f978ea983d3c tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:06.880778 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2d6e105b-014d-4451-8d4a-c48c992faa7d req-0e899abc-e836-40fa-961b-f978ea983d3c tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 946 time: 0.2916870 May 25 15:41:06.892481 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-9b79b3f7-ed53-4f2c-b979-32f2f290fa0c service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.9240651 May 25 15:41:06.956660 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-b1f035a5-1d6f-4f2d-8d73-5c087fae1e3d service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.4743960 May 25 15:41:06.965510 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] For port 6f230de1-4bde-4abc-ac21-bfe2eddf6700, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6f230de1-4bde-4abc-ac21-bfe2eddf6700,segment=NetworkSegment(feccb394-ccb2-48ac-98c1-f206da890375),segment_id=feccb394-ccb2-48ac-98c1-f206da890375)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:06.966328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.048424 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2d6e105b-014d-4451-8d4a-c48c992faa7d req-fd1db691-48b9-465d-bde1-d4a259311d23 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1665914 May 25 15:41:07.053598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.091051 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:07.101457 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Usage tracker for resource:security_group_rule and tenant:804353e83895441aa12d2bf6c087ff72 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:07.113991 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19a2310b-e58f-4066-8450-e164d83f5845 None None] New status for floating IP 4754fbd6-8842-4b6c-b280-b86c8a348c2f: ACTIVE {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:41:07.126877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:07.148944 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:07.156511 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-1e301cbe-be06-47e8-854d-6518fa55d202 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2732186 May 25 15:41:07.224996 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8852aea3-f8fb-409c-9034-67272cb22c8c up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:07.238208 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Calling delete_port for 6f230de1-4bde-4abc-ac21-bfe2eddf6700 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:41:07.385182 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-65c870dd-059f-4d0c-9cc5-58bebdac50e1 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2162690 May 25 15:41:07.441964 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.458214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.476497 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 8852aea3-f8fb-409c-9034-67272cb22c8c triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:07.476837 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.501628 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6ed6ff2c-b9e8-46fa-b980-ad1342c86c8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.566287 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=804353e83895441aa12d2bf6c087ff72&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8540773 May 25 15:41:07.569240 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42018) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:07.657298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cb8e6ae-d841-4ba1-9a41-8b8b749a4f29,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:07.662798 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.748447 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.780035 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.783127 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.829916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be6b6856-69e2-4eac-b853-af757b8eb714 req-d7394d72-d71f-41b8-8f5b-7997781dabfc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:07.831672 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be6b6856-69e2-4eac-b853-af757b8eb714 req-d7394d72-d71f-41b8-8f5b-7997781dabfc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1444352 May 25 15:41:07.862283 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f54a091f-0012-4f64-bb61-db1142e71a94 req-60f454f0-a947-43e3-85cb-0bce081d6e5d service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8698258 May 25 15:41:07.890814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-7173020a-0a94-443f-9481-6e6f78028b67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:07.892389 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-7173020a-0a94-443f-9481-6e6f78028b67 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.7016490 May 25 15:41:07.895327 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.903155 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be6b6856-69e2-4eac-b853-af757b8eb714 req-d5411dc3-d057-4fb2-b6c5-348cc849f124 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653589 May 25 15:41:07.905376 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e8929873-ea99-4ebc-bd18-a415ba162ba0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:07.917272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cb8e6ae-d841-4ba1-9a41-8b8b749a4f29,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:07.919684 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:07.932085 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:07.935592 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/5cb8e6ae-d841-4ba1-9a41-8b8b749a4f29 HTTP/1.1" status: 204 len: 168 time: 0.3626146 May 25 15:41:08.260044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42030) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:08.278469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.307636 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:08.311937 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Usage tracker for resource:security_group_rule and tenant:c3ec53739140498e9419ad814cc90584 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:08.315620 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:08.321647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:08.347718 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.378469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-db51a522-deb6-4e23-9383-fc286208afa8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.413879 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.417881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.426617 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f94c750-88f3-4700-9440-015cf0774279 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.430666 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Pushing event deleted for resources: {'Port': ['ID=6f230de1-4bde-4abc-ac21-bfe2eddf6700,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:08.433032 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-2329741a-1c8a-419c-a174-b57150715a4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:08.434478 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-2329741a-1c8a-419c-a174-b57150715a4c service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.4836335 May 25 15:41:08.438143 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.472647 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c3ec53739140498e9419ad814cc90584&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2114973 May 25 15:41:08.474345 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a2398a-0b9f-4890-aa1d-1c12f81e09e3,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:08.476650 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42036) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:08.487964 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.535783 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.562285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.582713 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-cd6e5f76-f126-4cec-8f8e-03393a5e82d3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.1071136 May 25 15:41:08.588953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.600958 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] No DVR routers for this DVR port 6f230de1-4bde-4abc-ac21-bfe2eddf6700 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:41:08.630200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.635354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f7093015-045c-483e-8a31-ccb01180317a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:08.647047 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a2398a-0b9f-4890-aa1d-1c12f81e09e3,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:08.654679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:08.656727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.659896 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c2a2398a-0b9f-4890-aa1d-1c12f81e09e3 HTTP/1.1" status: 204 len: 168 time: 0.1802917 May 25 15:41:08.695099 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:08.700355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'name': 'network-vif-deleted', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:08.755197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa03c24a-f9d3-4285-ace7-eade532b3e48 req-e3e427a2-2144-4d2c-9e0a-776e0d57fbe7 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:08.762402 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fa03c24a-f9d3-4285-ace7-eade532b3e48 req-e3e427a2-2144-4d2c-9e0a-776e0d57fbe7 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 867 time: 0.5473583 May 25 15:41:08.789126 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76837e96-02fc-46e9-bf8e-a0c0e19c1c19', 'name': 'network-vif-deleted', 'tag': '6f230de1-4bde-4abc-ac21-bfe2eddf6700', 'status': 'completed', 'code': 200} May 25 15:41:08.796768 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e9c04d21-3563-4a3e-941e-673b60769bc5 req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.70 "DELETE /v2.0/ports/6f230de1-4bde-4abc-ac21-bfe2eddf6700 HTTP/1.1" status: 204 len: 173 time: 3.6855412 May 25 15:41:08.900475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-f1c9d423-9eff-42e8-992f-2a92f1dc9240 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:08.902338 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-f1c9d423-9eff-42e8-992f-2a92f1dc9240 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.2991662 May 25 15:41:08.923513 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fa03c24a-f9d3-4285-ace7-eade532b3e48 req-ecd4bbc8-0457-4e6d-99f5-c04859673e58 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/security-groups?id=c64c8c69-bf12-464b-a985-719d420640f2&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1602550 May 25 15:41:08.978898 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-6d5919f3-b934-4618-8399-3e497d53b7db service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0514503 May 25 15:41:09.033861 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Router be216d63-ab76-431b-a541-90a9c25e4e84 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98462) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:41:09.225916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42064) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:09.459434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.479831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:09.483853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Usage tracker for resource:security_group_rule and tenant:632c332e478b42d0ab959972cebf1e44 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:09.487648 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:09.493916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:09.504187 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-b2973146-bf2d-4a15-abbf-56cd9f5e13ab service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4943678 May 25 15:41:09.524378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 req-3b88a955-3afc-4038-9214-c3a0f9f59cfc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:09.525983 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 req-3b88a955-3afc-4038-9214-c3a0f9f59cfc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.4888046 May 25 15:41:09.619550 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.622935 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:09.632272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.634500 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Sync routers for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:09.644907 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c53432d7-8f02-4a11-bb19-5007b5a97823 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:09.653064 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:09.654668 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:09.677210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.681961 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 7.7175643 May 25 15:41:09.682529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42084) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:09.705537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3cb9f65d-7318-41ce-a25a-9ffbf5d3c5c7 req-c0d1da3a-627b-491e-b86f-6f864c0fab59 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543024 May 25 15:41:09.741325 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93da5e2e-61e5-4828-b9e9-084e1f2a594e req-c96979a0-c72c-4e22-9628-890a7d1b21f6 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2116373 May 25 15:41:09.749452 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6f230de1-4bde-4abc-ac21-bfe2eddf6700 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:41:09.794171 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 6f230de1-4bde-4abc-ac21-bfe2eddf6700 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:41:09.794692 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6f230de1-4bde-4abc-ac21-bfe2eddf6700 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:41:09.801985 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=632c332e478b42d0ab959972cebf1e44&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5749431 May 25 15:41:09.804854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42088) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:09.805331 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3638fbcb-7707-40ff-9afe-9bc994cfd33d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:09.860638 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:09.885800 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.920229 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:09.956691 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:10.023436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.029232 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.046377 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3638fbcb-7707-40ff-9afe-9bc994cfd33d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:10.050454 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.052579 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.053714 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/3638fbcb-7707-40ff-9afe-9bc994cfd33d HTTP/1.1" status: 204 len: 168 time: 0.2478187 May 25 15:41:10.247824 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-751c9df9-6a89-427f-8c3a-8aa044edbee4 req-489f783b-c267-48bc-8528-20cd7cd03c79 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] 10.222.0.36 "GET /v2.0/ports?device_id=76837e96-02fc-46e9-bf8e-a0c0e19c1c19 HTTP/1.1" status: 200 len: 210 time: 0.0698798 May 25 15:41:10.414026 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:06Z', 'revision_number': 3, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:10.418657 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Checking router: be216d63-ab76-431b-a541-90a9c25e4e84 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:10.419014 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Updating router be216d63-ab76-431b-a541-90a9c25e4e84 port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:10.494948 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.609867 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.609987 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42112) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:10.644920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.674826 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:10.681113 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Usage tracker for resource:security_group_rule and tenant:c24c6be82ba247b78145742f60336b5d is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:10.684040 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:10.690651 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:10.794868 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.801079 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.812457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:10.864012 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c24c6be82ba247b78145742f60336b5d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2516246 May 25 15:41:10.870279 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42122) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:10.871351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff5a93a4-f8d5-49b2-a8b0-95972b83c02e,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:10.880791 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:10.947381 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:10.975599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.011271 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.043994 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.047369 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.052870 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b36fa723-684f-45fb-b708-2f2c7cfaa81d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.064311 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff5a93a4-f8d5-49b2-a8b0-95972b83c02e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:11.067460 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.072404 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Transition to ACTIVE for port object 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:11.074748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.078234 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/ff5a93a4-f8d5-49b2-a8b0-95972b83c02e HTTP/1.1" status: 204 len: 168 time: 0.1968355 May 25 15:41:11.092869 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.109121 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.127475 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4461fa-cddf-49a8-8898-d69429b9eea4 req-366ddece-5ac4-45ee-b385-7107aff46d5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:11.134809 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f4461fa-cddf-49a8-8898-d69429b9eea4 req-366ddece-5ac4-45ee-b385-7107aff46d5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2169738 May 25 15:41:11.196650 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Attempting to bind port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:11.197196 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Attempting to bind port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:11.197874 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Attempting to bind port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:11.208068 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:11.209395 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:11.210522 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.211064 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:11.211673 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Bound port: 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:11.212779 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.242498 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Pushing event updated for resources: {'Port': ['ID=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,revision_number=2']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:11.243040 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f4461fa-cddf-49a8-8898-d69429b9eea4 req-db049e66-c8d7-453a-8f4d-a7c3a87c9e74 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955751 May 25 15:41:11.281017 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.281485 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.282055 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.282502 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.283207 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.283958 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.284898 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.285411 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.285850 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.286262 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.286750 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.287211 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:11.293922 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.378863 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Allocated IP 172.20.0.1 (0d36140b-a597-4dfb-a417-ad474e1f632f/f8b27a4c-a2b0-40aa-b698-aaf984ec16be/c68c0459-ae1d-41e5-b070-8bf111cd22d5) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:11.469514 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] For port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:11.476117 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] For port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:11.487642 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.495960 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.632903 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:11.633521 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:11.653583 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.687652 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Transition to ACTIVE for port object c68c0459-ae1d-41e5-b070-8bf111cd22d5 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:11.692745 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Pushing event updated for resources: {'Port': ['ID=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:11.703117 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-22051edb-3c18-4dbc-8849-fd5fd155bb6e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:11.723744 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.730725 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:11.845574 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Network 0d36140b-a597-4dfb-a417-ad474e1f632f is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:11.849214 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:11.849697 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:11.866841 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:11.956186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:11.986575 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Pushing event updated for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:12.001133 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.184918 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-d05115a4-a792-4390-a4b5-eeb383881ce2 None None] Provisioning for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:12.198100 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:12.202177 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-d05115a4-a792-4390-a4b5-eeb383881ce2 None None] Provisioning complete for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:12.203259 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d05115a4-a792-4390-a4b5-eeb383881ce2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:12.342408 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-d05115a4-a792-4390-a4b5-eeb383881ce2 None None] Port c68c0459-ae1d-41e5-b070-8bf111cd22d5 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:12.394581 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:06Z', 'revision_number': 3, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:12.400960 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e95de14-f62f-4515-b2ca-19a86f09f3ab None None] The sync data for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi is: [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:06Z', 'revision_number': 3, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:12.566378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f997d1-78ca-4f41-aa23-8621016ab53d req-382f3bc5-c4d9-48df-b922-4d47a6c17361 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:12.570368 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02f997d1-78ca-4f41-aa23-8621016ab53d req-382f3bc5-c4d9-48df-b922-4d47a6c17361 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1194315 May 25 15:41:12.643914 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02f997d1-78ca-4f41-aa23-8621016ab53d req-0b7d48a7-2c82-4136-9b12-ce9f59aa4729 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579178 May 25 15:41:12.663434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:12.670081 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:12.700294 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7211ab22-cff3-49ea-904c-f8fec6ff31f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:12.790496 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Pushing event updated for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:12.794861 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:12.835978 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.006658 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Network 0d36140b-a597-4dfb-a417-ad474e1f632f is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:13.008029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:13.091835 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42198) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:13.265406 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Router be216d63-ab76-431b-a541-90a9c25e4e84 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:41:13.269620 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:13.349819 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.373718 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:13.380684 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Usage tracker for resource:security_group_rule and tenant:7ce084499e6948c6ae7dd011a2faa758 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:13.388221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:13.406212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:13.438946 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-464b914c-e28b-4e1b-bee5-10ccdcad6a80 None None] Provisioning complete for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:13.440428 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-464b914c-e28b-4e1b-bee5-10ccdcad6a80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.519157 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:13.525677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.529637 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:13.530018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.531468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.543316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-03d227dd-a1bb-4aff-a3c9-d7bbfe74a160 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.600879 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-464b914c-e28b-4e1b-bee5-10ccdcad6a80 None None] Port c68c0459-ae1d-41e5-b070-8bf111cd22d5 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:13.601846 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=7ce084499e6948c6ae7dd011a2faa758&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5086358 May 25 15:41:13.607384 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42212) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:13.612310 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c833643-a876-4608-a28e-d743eb39fb4b,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:13.617098 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.669861 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42220) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:13.692292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.713877 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:13.720069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.723671 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.727899 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.750090 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Deleting subnet 42c665bd-6d57-4ffa-8c85-4ad61909dc6f {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:41:13.753954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.780662 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.841190 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.868901 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:13.880084 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.885997 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:41:13.904538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.913781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-055597b7-d684-4b0d-bd90-ec29801c54f1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:13.929450 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:13.930873 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/5c833643-a876-4608-a28e-d743eb39fb4b HTTP/1.1" status: 204 len: 168 time: 0.3214734 May 25 15:41:13.932292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c833643-a876-4608-a28e-d743eb39fb4b,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:13.937132 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:13.996333 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] 10.222.0.36 "PUT /v2.0/routers/be216d63-ab76-431b-a541-90a9c25e4e84/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3024900 May 25 15:41:14.011837 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.176284 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77c2429-e918-456b-be98-f22a63218088 req-8f45b0b1-4d7b-4655-8676-850b61bbe55f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:14.177798 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a77c2429-e918-456b-be98-f22a63218088 req-8f45b0b1-4d7b-4655-8676-850b61bbe55f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2804108 May 25 15:41:14.263157 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a77c2429-e918-456b-be98-f22a63218088 req-c5a5fae3-2619-4c8e-88e3-c31705700394 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795894 May 25 15:41:14.367269 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.374439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e90c05fc-a6a8-40c7-bf2c-9e8347a824bf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:14.421993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=42c665bd-6d57-4ffa-8c85-4ad61909dc6f,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:14.426747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:14.427529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.434896 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/42c665bd-6d57-4ffa-8c85-4ad61909dc6f HTTP/1.1" status: 204 len: 168 time: 0.7637863 May 25 15:41:14.440507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42256) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:14.585403 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.587448 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Sync routers for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:41:14.605537 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:14.607381 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:14.738666 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.755642 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d995c251-7c0b-4025-9654-f6a6946e8b02']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:14.772252 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'feccb394-ccb2-48ac-98c1-f206da890375') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:14.772549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'feccb394-ccb2-48ac-98c1-f206da890375') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:14.785469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.806595 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.818680 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Releasing vlan 353 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:41:14.819239 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.876585 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:41:14.890697 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:41:14.934202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.944652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:14.950527 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:14.982072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Pushing event deleted for resources: {'Network': ['ID=d995c251-7c0b-4025-9654-f6a6946e8b02,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:14.990542 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:14.992148 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] 10.222.0.36 "DELETE /v2.0/networks/d995c251-7c0b-4025-9654-f6a6946e8b02 HTTP/1.1" status: 204 len: 168 time: 0.5506213 May 25 15:41:15.201804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:15.374937 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:15.380247 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.382612 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42308) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:15.488617 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-74033b5c-c5f7-4139-925c-0f68aec74956 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=6defbd5b403b44ac8c53cbf324a7f8c9&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1047230 May 25 15:41:15.490757 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42316) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:15.522798 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:12Z', 'revision_number': 4, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'c68c0459-ae1d-41e5-b070-8bf111cd22d5', 'name': '', 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'mac_address': 'fa:16:3e:20:63:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:11Z', 'updated_at': '2021-05-25T15:41:12Z', 'revision_number': 2, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'subnets': [{'id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:15.530427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Checking router: be216d63-ab76-431b-a541-90a9c25e4e84 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:41:15.531025 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Updating router be216d63-ab76-431b-a541-90a9c25e4e84 port c68c0459-ae1d-41e5-b070-8bf111cd22d5 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:41:15.572589 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.637110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.639526 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.750443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da5b362-1106-4911-89ef-411be576dd5d req-6e137698-18b5-45e2-b309-dc2ccaa05e5c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:15.758365 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3da5b362-1106-4911-89ef-411be576dd5d req-6e137698-18b5-45e2-b309-dc2ccaa05e5c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2623835 May 25 15:41:15.774793 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.779264 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:15.867797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c64c8c69-bf12-464b-a985-719d420640f2,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:15.874318 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:15.891123 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:15.894730 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3da5b362-1106-4911-89ef-411be576dd5d req-534860b1-cbdc-44b7-b908-53ff33b476c6 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255856 May 25 15:41:15.894900 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c64c8c69-bf12-464b-a985-719d420640f2 HTTP/1.1" status: 204 len: 168 time: 0.4002333 May 25 15:41:16.140769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42328) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:16.350804 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.402582 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:16.416741 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Usage tracker for resource:security_group_rule and tenant:361d808221ca4503ac666db0bd9c552d is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:16.434438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:16.441730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:16.448627 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.476797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Transition to ACTIVE for port object c68c0459-ae1d-41e5-b070-8bf111cd22d5 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:16.491297 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.498019 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-9e94dbb8-b892-41af-984f-36fa695adf3b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.630874 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.638430 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.649000 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ed039860-dbf4-44c3-99ef-8efd07480994 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:16.711097 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=361d808221ca4503ac666db0bd9c552d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5690136 May 25 15:41:16.713978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42350) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:16.715014 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fda24be8-09a4-4d23-9991-a8dfb490e22d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:16.736476 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.737877 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Pushing event updated for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:16.748103 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:16.820396 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.859828 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Attempting to bind port c68c0459-ae1d-41e5-b070-8bf111cd22d5 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:16.860080 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Attempting to bind port c68c0459-ae1d-41e5-b070-8bf111cd22d5 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:16.860418 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Attempting to bind port c68c0459-ae1d-41e5-b070-8bf111cd22d5 on network 0d36140b-a597-4dfb-a417-ad474e1f632f {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:16.866428 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:16.866807 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Checking segment: {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:16.867262 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.867790 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Bound using segment: {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:16.868631 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Bound port: c68c0459-ae1d-41e5-b070-8bf111cd22d5, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 369, 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:16.869262 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.880870 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.961724 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:16.983274 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ee23f908-284b-41d1-9e66-aba3bf4c095d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:17.012796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fda24be8-09a4-4d23-9991-a8dfb490e22d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:17.021471 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:17.026173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.027553 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/fda24be8-09a4-4d23-9991-a8dfb490e22d HTTP/1.1" status: 204 len: 168 time: 0.3126097 May 25 15:41:17.039010 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] For port c68c0459-ae1d-41e5-b070-8bf111cd22d5, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:17.042592 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] For port c68c0459-ae1d-41e5-b070-8bf111cd22d5, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c68c0459-ae1d-41e5-b070-8bf111cd22d5,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:17.058139 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.070447 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:17.181121 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Pushing event updated for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:17.196665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:17.227013 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:41:17.228508 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:41:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:17.251243 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ce827c-c4d8-40b6-ad66-1939566f6ebc req-a726a154-8a31-4334-a566-97ca1a1bde88 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:17.263761 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38ce827c-c4d8-40b6-ad66-1939566f6ebc req-a726a154-8a31-4334-a566-97ca1a1bde88 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1331606 May 25 15:41:17.385068 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38ce827c-c4d8-40b6-ad66-1939566f6ebc req-00810443-03b3-4b3c-a514-e37e68342736 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182947 May 25 15:41:17.646576 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:41:17.716437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42380) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:17.750703 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.768709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:17.774582 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Usage tracker for resource:security_group_rule and tenant:b7dfd7f22d8848fc9b363415a1345b93 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:17.778010 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:17.788150 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:17.931206 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.940481 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:17.948715 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-01336b04-6b22-4915-91e9-88013ea7dc0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.006496 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53f897a3-41a6-45c1-b2d1-e6ee82e6b604,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.027902 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=b7dfd7f22d8848fc9b363415a1345b93&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3096666 May 25 15:41:18.029924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42390) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:18.031088 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.159733 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.203946 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.302208 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.306151 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:18.334281 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53f897a3-41a6-45c1-b2d1-e6ee82e6b604,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:18.349054 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:18.364201 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:18.366886 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/53f897a3-41a6-45c1-b2d1-e6ee82e6b604 HTTP/1.1" status: 204 len: 168 time: 0.3358531 May 25 15:41:18.465755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:12Z', 'revision_number': 4, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'c68c0459-ae1d-41e5-b070-8bf111cd22d5', 'name': '', 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'mac_address': 'fa:16:3e:20:63:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:11Z', 'updated_at': '2021-05-25T15:41:17Z', 'revision_number': 4, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'subnets': [{'id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:41:18.470342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64bffb9f-fe41-4be5-ace6-0cc80889c0e6 None None] The sync data for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi is: [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:41:12Z', 'revision_number': 4, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'c68c0459-ae1d-41e5-b070-8bf111cd22d5', 'name': '', 'network_id': '0d36140b-a597-4dfb-a417-ad474e1f632f', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'mac_address': 'fa:16:3e:20:63:1d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_interface', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:11Z', 'updated_at': '2021-05-25T15:41:17Z', 'revision_number': 4, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'subnets': [{'id': 'f8b27a4c-a2b0-40aa-b698-aaf984ec16be', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:41:19.044622 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8604cacc-fc4c-48de-abf8-50e2e0d76942 req-84019f2b-152f-4a61-91d2-2f494465580b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:19.048033 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8604cacc-fc4c-48de-abf8-50e2e0d76942 req-84019f2b-152f-4a61-91d2-2f494465580b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.3305976 May 25 15:41:19.143960 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8604cacc-fc4c-48de-abf8-50e2e0d76942 req-7e4d6b97-c5f0-4485-95a5-0a9d7a31c2c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0655782 May 25 15:41:19.261270 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:41:19.274501 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c68c0459-ae1d-41e5-b070-8bf111cd22d5 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:19.388922 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:19.399081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:19.399498 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.610669 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.657505 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port c68c0459-ae1d-41e5-b070-8bf111cd22d5, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c68c0459-ae1d-41e5-b070-8bf111cd22d5,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:19.665812 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:19.670696 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:19.937094 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:19.942514 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:20.522635 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 req-d2ee10eb-8ff6-4868-8d6b-8ddfaaf25acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:20.524978 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 req-d2ee10eb-8ff6-4868-8d6b-8ddfaaf25acf tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1223326 May 25 15:41:20.590737 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b717f5b3-2fd2-4d98-aea6-6e35f75ff644 req-5eb7cb5e-0586-4b08-94c8-ae1dd5b2b8fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578992 May 25 15:41:21.207018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c68c0459-ae1d-41e5-b070-8bf111cd22d5 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:41:21.333247 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port c68c0459-ae1d-41e5-b070-8bf111cd22d5 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:21.333818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:21.886513 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414f17fc-b40a-4091-b529-e29b9ee10370 req-77b34375-9bf8-405f-b4ce-84e402e3afb2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:21.895360 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-414f17fc-b40a-4091-b529-e29b9ee10370 req-77b34375-9bf8-405f-b4ce-84e402e3afb2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1500189 May 25 15:41:21.946194 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-414f17fc-b40a-4091-b529-e29b9ee10370 req-ba144db1-0276-4327-89fc-4e56bf78149a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496223 May 25 15:41:23.246650 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18fe9f78-0b70-4a37-93bc-856f525f30cc req-94750e1b-fed8-4004-a7ae-853e47ff1bcc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:23.255456 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-18fe9f78-0b70-4a37-93bc-856f525f30cc req-94750e1b-fed8-4004-a7ae-853e47ff1bcc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1566002 May 25 15:41:23.334978 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-18fe9f78-0b70-4a37-93bc-856f525f30cc req-48eaf550-a63b-4744-a13e-47a7b85ecfb5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784230 May 25 15:41:24.605079 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c req-c4e5d447-5653-444f-96d8-98362b072156 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:24.612007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c req-c4e5d447-5653-444f-96d8-98362b072156 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1383958 May 25 15:41:24.669807 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-98ce5228-d852-4fbf-9c1a-64fcf651ee3c req-d06badf5-ecf3-46d3-8465-ce9a96adf4b5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568783 May 25 15:41:29.277277 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea573a9-f32b-4ac9-be32-29ef6ced71fc req-fddbeb2f-ffde-4ca0-a63e-3d12ad72dd8c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:29.278749 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bea573a9-f32b-4ac9-be32-29ef6ced71fc req-fddbeb2f-ffde-4ca0-a63e-3d12ad72dd8c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.0859404 May 25 15:41:29.323198 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bea573a9-f32b-4ac9-be32-29ef6ced71fc req-59880c9a-13af-44a4-90da-c92eb623442d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387266 May 25 15:41:29.811626 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-07fc3218-d47b-4374-acca-e5b305f91b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:29.812330 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-743a8892-449a-4924-af27-8383c5d3d131 req-07fc3218-d47b-4374-acca-e5b305f91b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:29.828525 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-743a8892-449a-4924-af27-8383c5d3d131 req-07fc3218-d47b-4374-acca-e5b305f91b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:29.829669 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-07fc3218-d47b-4374-acca-e5b305f91b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 815 time: 0.1598375 May 25 15:41:29.844377 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-efdb8c27-ffe3-464e-ba0d-e4e12edbe22d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/quotas/55dc60a2768e4d2db35d44c21ff0e0a6 HTTP/1.1" status: 200 len: 375 time: 0.0086100 May 25 15:41:29.927825 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-125dc89f-2056-4bac-afa4-81401b417033 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0781024 May 25 15:41:29.967370 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cf7de22d-78ac-4aca-81c4-e9c16f0f96ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:30.144231 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-ea3ab6df-3c67-451a-84db-6b00e853b32c service neutron] 10.222.0.36 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2047396 May 25 15:41:30.296580 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-1580cac5-4932-4310-8515-ec67f0a8d820 service neutron] 10.222.0.36 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1476090 May 25 15:41:30.531405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c req-0662a6c8-01b0-4a2b-bf25-db39e5e93874 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:30.555471 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c req-0662a6c8-01b0-4a2b-bf25-db39e5e93874 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:30.558434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-46c0ba6b-447f-40ee-b3ce-4bf13585e59c req-0662a6c8-01b0-4a2b-bf25-db39e5e93874 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 210 time: 0.1007245 May 25 15:41:30.602014 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52fc535a-6349-457f-85a0-d2398bb8f0ef req-bc815303-2b0d-4a06-8e20-47819aac61b1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:30.603582 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-52fc535a-6349-457f-85a0-d2398bb8f0ef req-bc815303-2b0d-4a06-8e20-47819aac61b1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.0957708 May 25 15:41:30.651493 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-52fc535a-6349-457f-85a0-d2398bb8f0ef req-c225475b-bb49-41c4-9155-4c99b4e3c2a3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413051 May 25 15:41:31.149116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42788) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:31.285553 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.300852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:31.304636 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Usage tracker for resource:security_group_rule and tenant:d78b668c59584367936169aa812f25b2 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:31.308101 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:31.316258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:31.408892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.413829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.428179 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f99d902e-e93a-4966-a838-8e8021c84247 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.473731 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=d78b668c59584367936169aa812f25b2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3234332 May 25 15:41:31.475828 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48507242-50a2-4263-8eb4-1e8a3ea800a4,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:31.476364 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42804) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:31.483512 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.546759 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.573923 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.632299 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.638966 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3df457d8-5987-4df1-b0e4-77ffed00f7d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:31.652942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48507242-50a2-4263-8eb4-1e8a3ea800a4,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:31.656589 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:31.672250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:31.673599 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/48507242-50a2-4263-8eb4-1e8a3ea800a4 HTTP/1.1" status: 204 len: 168 time: 0.1957009 May 25 15:41:31.763501 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af06c38a-79c0-4363-a214-a1cde9013aae req-c8adf235-8af8-4a00-a978-a6326498254a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 210 time: 0.0880570 May 25 15:41:31.968686 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf8abe7-209b-4681-aadd-1d071d873bb5 req-847f59bb-b35c-4a56-9a22-7108bce1ae0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:31.970921 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-baf8abe7-209b-4681-aadd-1d071d873bb5 req-847f59bb-b35c-4a56-9a22-7108bce1ae0b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1718419 May 25 15:41:32.043300 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-baf8abe7-209b-4681-aadd-1d071d873bb5 req-5fa9e7ff-c051-48fb-96be-2b5ab9dbb7c4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665245 May 25 15:41:32.071657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-5eed22cb-e198-4a05-828c-c0a3115ad89e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:32.074924 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-5eed22cb-e198-4a05-828c-c0a3115ad89e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 815 time: 0.2392521 May 25 15:41:32.125250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'port': {'device_id': '17e39efa-e568-41dd-9368-376ead8b1020', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'admin_state_up': True, 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:32.178013 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42830) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:32.195600 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.211092 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:32.215939 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Usage tracker for resource:security_group_rule and tenant:bd60b8c37c1b422ab24a136c59287346 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:32.219079 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:32.227918 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:32.311635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:32.323229 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:32.343829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Made reservation on behalf of 55dc60a2768e4d2db35d44c21ff0e0a6 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:32.343829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.410308 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.421103 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.460809 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.550097 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=bd60b8c37c1b422ab24a136c59287346&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3685732 May 25 15:41:32.550097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa2b1ce2-3b63-4bd2-937a-9fae563ddaa1,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:32.551018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42854) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:32.583646 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.637941 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.638558 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Allocated IP 172.20.0.5 (07e4e701-ccf8-451e-b3d9-a809a6936fed/79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc/c536b9e5-ae17-4775-b209-71e6ec42122a) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:32.669096 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.698096 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-beb03472-87c0-4fa9-b062-21badebb6a5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.702110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.768222 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.773953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eaae3e1d-80c9-40c3-9334-942999cb099f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:32.786720 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa2b1ce2-3b63-4bd2-937a-9fae563ddaa1,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:32.790276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:32.792574 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.810555 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/aa2b1ce2-3b63-4bd2-937a-9fae563ddaa1 HTTP/1.1" status: 204 len: 168 time: 0.2584903 May 25 15:41:32.979447 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:32.996046 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a2b9a6b3-24e7-4067-9a48-913464f0991f req-b002f63e-af3b-4998-a196-1451c8a2271a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 210 time: 0.0598986 May 25 15:41:33.007394 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Transition to ACTIVE for port object c536b9e5-ae17-4775-b209-71e6ec42122a will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:33.045853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.055089 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.217688 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:33.222080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:33.225216 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:33.297839 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.304877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.305355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42886) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:33.340463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.366164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:33.371112 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Usage tracker for resource:security_group_rule and tenant:12d2981c2371468b8046790991092a73 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:33.374780 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:33.382627 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:33.432632 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.447145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:33.447813 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.454629 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 req-fc8eaeb8-81eb-46a3-bd20-3926701fe516 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:33.468830 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 req-fc8eaeb8-81eb-46a3-bd20-3926701fe516 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2067051 May 25 15:41:33.515923 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3946321 May 25 15:41:33.528469 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e1047fb1-12e1-4f51-8f47-83be1ec63fb4 req-d4c5e435-22f5-479a-a929-63b5e801cded tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586944 May 25 15:41:33.534333 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.541698 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.551042 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bc2ad9d2-fe5f-4c46-9912-fa0a817d1f55 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.603733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-5cdd2bff-40cc-42f6-b384-070a110fa509 None None] Provisioning for port c536b9e5-ae17-4775-b209-71e6ec42122a completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:33.610120 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-5cdd2bff-40cc-42f6-b384-070a110fa509 None None] Provisioning complete for port c536b9e5-ae17-4775-b209-71e6ec42122a triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:33.612045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-5cdd2bff-40cc-42f6-b384-070a110fa509 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.687539 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=12d2981c2371468b8046790991092a73&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3811109 May 25 15:41:33.688594 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c0b5f52b-19cd-4795-be09-fdfa15df8589,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.690712 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42900) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:33.703646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.729041 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-5cdd2bff-40cc-42f6-b384-070a110fa509 None None] Port c536b9e5-ae17-4775-b209-71e6ec42122a cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:33.774803 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.801845 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.861582 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.875566 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2f1d2f33-2739-4f07-83d9-46a37e3a1426 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:33.907175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c0b5f52b-19cd-4795-be09-fdfa15df8589,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:33.912820 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:33.914717 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:33.919917 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c0b5f52b-19cd-4795-be09-fdfa15df8589 HTTP/1.1" status: 204 len: 168 time: 0.2261341 May 25 15:41:34.233751 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42924) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:34.359171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.374244 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:34.378850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Usage tracker for resource:security_group_rule and tenant:cf7eeb3f47f34181a3b749f28537ed07 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:34.382968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:34.389485 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:34.478417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.482432 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.492017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c6aab057-eecf-4f54-805a-4ef4c79f51fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:34.538585 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=cf7eeb3f47f34181a3b749f28537ed07&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3037033 May 25 15:41:34.540738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3512a78f-b34c-4f8b-a768-3d736cdd06c4,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.541143 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42942) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:34.544891 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.610174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.648056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.709399 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.714654 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-62ccc489-0c5f-43f4-aaff-ab9078d8260f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:34.728076 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3512a78f-b34c-4f8b-a768-3d736cdd06c4,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:34.731189 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:34.732335 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:34.740713 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/3512a78f-b34c-4f8b-a768-3d736cdd06c4 HTTP/1.1" status: 204 len: 168 time: 0.1983631 May 25 15:41:35.137980 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 42968) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:35.158595 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.160671 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.175525 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:35.184599 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Usage tracker for resource:security_group_rule and tenant:7df12db730594f4ca5bf9c476a37d932 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:35.187738 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:35.194785 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:35.293657 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.297761 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.307020 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f4e61ae-4c29-4ddd-b756-6ae8cbd0e002 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:35.348135 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=7df12db730594f4ca5bf9c476a37d932&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2090652 May 25 15:41:35.349977 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f309a3e9-d8b4-40a9-b7e6-45047cf7485e,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:35.350851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 42976) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:35.354064 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:35.431178 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.458063 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.515061 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.519448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7e0d8e8b-fe78-4843-b945-ba91bc69f523 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:35.537407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f309a3e9-d8b4-40a9-b7e6-45047cf7485e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:35.541995 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:35.548417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:35.550157 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f309a3e9-d8b4-40a9-b7e6-45047cf7485e HTTP/1.1" status: 204 len: 168 time: 0.1983321 May 25 15:41:39.883381 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43076) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:40.015413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.029898 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:40.033630 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Usage tracker for resource:security_group_rule and tenant:c43675ec80594e419cbf1b1a5eb8c1e2 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:40.036362 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:40.042078 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:40.125189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.130530 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.137928 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-27932cb6-38ac-457b-89c6-b5c59742442e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:40.264463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c6595cc-75ae-4aba-9978-63ff93ef1d28,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:40.268770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:40.274344 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c43675ec80594e419cbf1b1a5eb8c1e2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3871617 May 25 15:41:40.275354 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43084) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:40.335958 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.368041 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.421773 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.426065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:40.437260 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c6595cc-75ae-4aba-9978-63ff93ef1d28,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:40.441738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:40.443568 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:40.444723 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/1c6595cc-75ae-4aba-9978-63ff93ef1d28 HTTP/1.1" status: 204 len: 168 time: 0.1693082 May 25 15:41:40.582746 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.123192 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43100) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:41.266659 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.282029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:41.285849 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Usage tracker for resource:security_group_rule and tenant:b0a839f7176e4ca4b22bb189ba73afad is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:41.288666 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:41.294383 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:41.418171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.423630 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.435330 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-91c4d89a-7017-471e-8b78-828e693399d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:41.476169 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df2271e2-4c5c-4759-920e-3725385e2bd8,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:41.483297 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=b0a839f7176e4ca4b22bb189ba73afad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3590326 May 25 15:41:41.483488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43112) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:41.484275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:41.571195 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.598674 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.659848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.664730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb62e3dd-2e2f-437d-87c8-86ad5ac4ac68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:41.679124 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df2271e2-4c5c-4759-920e-3725385e2bd8,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:41.682190 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:41.686389 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:41.690763 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/df2271e2-4c5c-4759-920e-3725385e2bd8 HTTP/1.1" status: 204 len: 168 time: 0.2039478 May 25 15:41:42.045388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43128) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:42.062998 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.079306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:42.084355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Usage tracker for resource:security_group_rule and tenant:0c9211cd2d8141abaa172825e6c59fae is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:42.097924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:42.104209 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:42.190874 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.206077 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.215025 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:42.256847 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=0c9211cd2d8141abaa172825e6c59fae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2104027 May 25 15:41:42.257842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43b3475c-fac2-4c42-a17a-8f7fde90e0db,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.259806 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43132) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:42.261237 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:42.332197 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.372718 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.431445 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.435038 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a315fa71-dfa8-4359-8c0d-79a6478f7e92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:42.446330 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43b3475c-fac2-4c42-a17a-8f7fde90e0db,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:42.450128 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:42.453240 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:42.457131 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/43b3475c-fac2-4c42-a17a-8f7fde90e0db HTTP/1.1" status: 204 len: 168 time: 0.1954694 May 25 15:41:49.946148 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43278) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:50.062518 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.077651 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:50.082200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Usage tracker for resource:security_group_rule and tenant:8df6796ad8934ff693eb259b7a0d4704 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:50.085116 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:50.091106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:50.173893 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.177840 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.185400 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a19cf344-440f-426a-a561-21e513ccf1fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.226184 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=8df6796ad8934ff693eb259b7a0d4704&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2789462 May 25 15:41:50.227083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec2e0390-d5a0-4743-a005-a3503c5c1e51,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:50.228839 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43284) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:50.230372 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.289818 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.314984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.363805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Request body: {'port': {'device_id': '17e39efa-e568-41dd-9368-376ead8b1020', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:50.411007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.418160 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:50.465447 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec2e0390-d5a0-4743-a005-a3503c5c1e51,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:50.474448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:50.505086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.509085 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/ec2e0390-d5a0-4743-a005-a3503c5c1e51 HTTP/1.1" status: 204 len: 168 time: 0.2791255 May 25 15:41:50.514339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.623373 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c3144d8-ffd0-4f00-a846-465898edaafa req-bf800108-06ca-48c8-b2a5-62a8a90f7399 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:50.625033 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7c3144d8-ffd0-4f00-a846-465898edaafa req-bf800108-06ca-48c8-b2a5-62a8a90f7399 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1094027 May 25 15:41:50.681489 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7c3144d8-ffd0-4f00-a846-465898edaafa req-3618bb82-b0b7-46cc-9ec2-11e1ff4f3610 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499783 May 25 15:41:50.698831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 req-0b14f6a2-4dc3-4461-acf4-db186173ab32 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:50.698831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 req-0b14f6a2-4dc3-4461-acf4-db186173ab32 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:50.776158 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 req-0b14f6a2-4dc3-4461-acf4-db186173ab32 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:50.777324 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 req-0b14f6a2-4dc3-4461-acf4-db186173ab32 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 931 time: 0.2518282 May 25 15:41:50.843679 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-675877fc-c312-4c13-a257-5bc965c97115 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/networks?tenant_id=be5fb171d503440e86a06009ac0dceef&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0356450 May 25 15:41:50.907537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-987f45bb-8572-4ff0-b49a-0697a1bd7a07 req-82fd4854-8921-4f19-9fd0-54b0d6132603 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216333 May 25 15:41:50.945588 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43310) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:50.967704 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:50.986955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:50.993288 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Usage tracker for resource:security_group_rule and tenant:bc53029f92ae41d997ca8c93314d8899 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:51.007738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:51.015164 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-903227bd-ef4f-47d7-8ba7-64f22a7d916a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.016665 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-903227bd-ef4f-47d7-8ba7-64f22a7d916a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1663749 May 25 15:41:51.017130 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:51.031968 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-10584d8a-df31-454f-bea0-91439e891d5b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/quotas/be5fb171d503440e86a06009ac0dceef HTTP/1.1" status: 200 len: 375 time: 0.0090528 May 25 15:41:51.082808 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-5322ddd2-e8b4-4ce3-b946-f3bf1f0dd675 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=be5fb171d503440e86a06009ac0dceef&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0450063 May 25 15:41:51.088575 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c536b9e5-ae17-4775-b209-71e6ec42122a {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:51.105805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.128624 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Transition to ACTIVE for port object c536b9e5-ae17-4775-b209-71e6ec42122a will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:51.134020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.139652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b179387a-081c-4225-83a5-f509a4b03d42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.337965 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-224b8b99-ac6b-4f6b-b22a-497f5e22fdf2 req-63d8db51-67fb-4827-8d01-be1110956246 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 210 time: 0.0791807 May 25 15:41:51.338599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.349480 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.389070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.394873 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.418872 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.511553 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=bc53029f92ae41d997ca8c93314d8899&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5648410 May 25 15:41:51.514311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43326) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:51.524205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92109eb3-185d-4290-8fa3-7d7bfdc6555b,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.528727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.550720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Attempting to bind port c536b9e5-ae17-4775-b209-71e6ec42122a on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:51.551048 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Attempting to bind port c536b9e5-ae17-4775-b209-71e6ec42122a by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:51.551369 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Attempting to bind port c536b9e5-ae17-4775-b209-71e6ec42122a on network 07e4e701-ccf8-451e-b3d9-a809a6936fed {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:51.556102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Port c536b9e5-ae17-4775-b209-71e6ec42122a on network 07e4e701-ccf8-451e-b3d9-a809a6936fed not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:41:51.556423 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Attempting to bind port c536b9e5-ae17-4775-b209-71e6ec42122a on network 07e4e701-ccf8-451e-b3d9-a809a6936fed {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:51.561883 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:51.562041 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Checking segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:51.562291 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Bound using segment: {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:51.563468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Bound port: c536b9e5-ae17-4775-b209-71e6ec42122a, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e4241c72-10f5-428f-970e-cab7555df934', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:51.563468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.661210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:51.664686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:51.667727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.669302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.673961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.698983 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.735719 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:51.736372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.737791 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] 10.222.0.70 "PUT /v2.0/ports/c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 1093 time: 1.3782918 May 25 15:41:51.738277 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:51.764429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.769434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:51.777024 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.788389 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92109eb3-185d-4290-8fa3-7d7bfdc6555b,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:51.789772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.807916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.808393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.808754 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.809105 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.809454 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.809803 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.810146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.810488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.810831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.811172 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.811510 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.811845 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:51.817019 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:51.818043 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:51.820001 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/92109eb3-185d-4290-8fa3-7d7bfdc6555b HTTP/1.1" status: 204 len: 168 time: 0.3041604 May 25 15:41:51.825504 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:41:52.057753 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-c4e8bf90-bfc4-4507-a2ae-0c7ea0814892 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.059199 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-c4e8bf90-bfc4-4507-a2ae-0c7ea0814892 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1096 time: 0.1932130 May 25 15:41:52.071555 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-388de10c-5bee-49f9-97e6-22adabc27f6f req-7145b3d1-8865-4c9c-ba7a-61bfb2830e85 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.073227 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-388de10c-5bee-49f9-97e6-22adabc27f6f req-7145b3d1-8865-4c9c-ba7a-61bfb2830e85 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1441345 May 25 15:41:52.215015 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe57fc2-056d-4092-84e5-7e2b9057146f req-ace442d2-53e6-49af-99fd-ed65087c9e26 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.218339 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3fe57fc2-056d-4092-84e5-7e2b9057146f req-ace442d2-53e6-49af-99fd-ed65087c9e26 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 943 time: 0.1213217 May 25 15:41:52.294596 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-3fe57fc2-056d-4092-84e5-7e2b9057146f req-056d6b61-4837-4b58-9fcf-7ec59542e3e5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:52.314353 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-3fe57fc2-056d-4092-84e5-7e2b9057146f req-056d6b61-4837-4b58-9fcf-7ec59542e3e5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:52.316667 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3fe57fc2-056d-4092-84e5-7e2b9057146f req-056d6b61-4837-4b58-9fcf-7ec59542e3e5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839117 May 25 15:41:52.383364 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-592a8576-c6a2-4605-97c0-633ac00c10b3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 217 time: 0.3087988 May 25 15:41:52.505288 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-388de10c-5bee-49f9-97e6-22adabc27f6f req-b4043b30-e7a8-494f-b9b7-1527cf7edf24 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1671870 May 25 15:41:52.507950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-84c37c28-21c3-4b6a-b45e-a67e39daaaca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.509349 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-84c37c28-21c3-4b6a-b45e-a67e39daaaca service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.1079371 May 25 15:41:52.520460 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9ea6aa5a-f3b2-4ba2-b6b7-5386d6fe0a19 req-3ba72c91-2359-4f1d-80ff-4944dde740e5 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 210 time: 0.0504344 May 25 15:41:52.521735 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f531a47-d54f-405e-97d9-8cd8abea05c1 req-068d3c36-320e-427c-81a7-2842b8c567cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.523263 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f531a47-d54f-405e-97d9-8cd8abea05c1 req-068d3c36-320e-427c-81a7-2842b8c567cf service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1099 time: 0.1919615 May 25 15:41:52.628072 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f531a47-d54f-405e-97d9-8cd8abea05c1 req-9420dde8-026f-4def-97f4-495d308844dd service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563245 May 25 15:41:52.646081 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-743a8892-449a-4924-af27-8383c5d3d131 req-412f3c2b-9e02-4ac2-adc5-f4c1374ca352 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:52.648099 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-412f3c2b-9e02-4ac2-adc5-f4c1374ca352 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1238282 May 25 15:41:52.872576 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-25a346a2-1681-4335-b6bb-f0fe5e8c50a1 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1316104 May 25 15:41:53.056540 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-1ef7e033-38fa-4cea-a227-258ceb55db63 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.70 "GET /v2.0/networks?tenant_id=be5fb171d503440e86a06009ac0dceef&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0366762 May 25 15:41:53.151241 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-743a8892-449a-4924-af27-8383c5d3d131 req-520687bf-f9e0-4be4-b344-04efbea00374 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2499905 May 25 15:41:53.235547 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-032d1a5e-2ec9-47b6-a8da-5b1e0c39f72b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.237166 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-032d1a5e-2ec9-47b6-a8da-5b1e0c39f72b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1714823 May 25 15:41:53.309505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Request body: {'port': {'device_id': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0', 'admin_state_up': True, 'tenant_id': 'be5fb171d503440e86a06009ac0dceef'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:53.527955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-e4d39e90-c7c5-4e29-9039-4944dcfb838c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.529330 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-e4d39e90-c7c5-4e29-9039-4944dcfb838c service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1096 time: 0.2597489 May 25 15:41:53.539968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:53.542444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Usage tracker for resource:port and tenant:be5fb171d503440e86a06009ac0dceef is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:53.544996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:53.552442 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:53.644443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Made reservation on behalf of be5fb171d503440e86a06009ac0dceef for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:41:53.648000 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.669408 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:53.698213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15eee5a-82ca-4907-b659-05996e6de4a0 req-1973b311-11e7-4f96-9c5e-e6e79d9299f8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.699691 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b15eee5a-82ca-4907-b659-05996e6de4a0 req-1973b311-11e7-4f96-9c5e-e6e79d9299f8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 943 time: 0.2539916 May 25 15:41:53.708517 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:53.729127 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Usage tracker for resource:security_group_rule and tenant:be5fb171d503440e86a06009ac0dceef is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:53.729347 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 req-0a4aa734-43af-4104-ab96-41d2cd1d9c50 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.730711 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 req-0a4aa734-43af-4104-ab96-41d2cd1d9c50 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.0809877 May 25 15:41:53.733531 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:53.756373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:53.780875 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-86a0e16a-042f-4bfd-bba2-4d82b0d9b387 req-087eebe9-79d6-4209-8538-14ba114db033 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444396 May 25 15:41:53.829408 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b15eee5a-82ca-4907-b659-05996e6de4a0 req-6b19e7f1-6d38-4cf9-a421-b50b42fcb90c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1184912 May 25 15:41:53.832908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-7c53b4c4-5790-4905-8caa-ce4e51a2eaaa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:53.834330 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-7c53b4c4-5790-4905-8caa-ce4e51a2eaaa service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.2778263 May 25 15:41:53.924527 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-784d4c9e-9fc0-4a9f-a40e-2378a1663157 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 217 time: 0.0685074 May 25 15:41:53.951002 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-110c4d84-5a75-4bfa-91ce-5105a69e93df req-e1f032f6-fd9c-4b51-949a-d449cb9a6379 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 210 time: 0.0534046 May 25 15:41:54.022391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.029582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-d93ff5f4-ad12-4181-861f-8a6e2ea40e42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:54.032588 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-d93ff5f4-ad12-4181-861f-8a6e2ea40e42 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0938928 May 25 15:41:54.033654 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.037056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fcb4e61a-035c-40da-88ec-c9e4403a90a1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.252629 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9ba7386a-c9ab-4128-9d00-1c68e2bac39a,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:54.275638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.276032 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.276406 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.276764 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.277104 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.277461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.277798 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.278133 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.278476 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.278804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.279133 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.279536 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:54.291822 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:54.368987 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-f0a4969f-de39-42c6-867e-65c0211c6baa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:54.370392 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-f0a4969f-de39-42c6-867e-65c0211c6baa service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2873051 May 25 15:41:54.380378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Allocated IP 192.168.233.54 (4fce4df0-5246-42d6-ba2e-1012d59d04c0/935cff87-3f66-4e7b-bcf5-f2c231ee8848/0d049ba8-f49c-4e51-b70c-b3c7bcb786d5) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:41:54.637753 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-73e09919-2075-4891-bcfd-8ce6f3c06c07 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2475116 May 25 15:41:54.820005 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.848676 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c54fbe1-d7a8-452a-bb4f-9d53658d9469 req-cc58caba-3392-4eac-ac58-fcfec749787e service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1952164 May 25 15:41:54.851307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Transition to ACTIVE for port object 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:54.879043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:54.885257 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:54.951993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43462) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:55.011059 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:41:55.016990 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:41:55.023582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:41:55.051434 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Pushing event updated for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:55.054271 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 req-cbb2e1ba-4271-4096-a5f1-dc9d61412ed6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.058720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.073596 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 req-cbb2e1ba-4271-4096-a5f1-dc9d61412ed6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 943 time: 0.1064095 May 25 15:41:55.107262 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.107918 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.116470 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.147992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 req-0a9ad2c4-bb4e-4d10-9a5b-f3fe27a06b6a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.150107 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 req-0a9ad2c4-bb4e-4d10-9a5b-f3fe27a06b6a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.2105994 May 25 15:41:55.158483 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:41:55.167183 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Usage tracker for resource:security_group_rule and tenant:cd28631696804ee0ba8ebf70d79c9062 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:41:55.172603 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a4e3318d-36ea-40c6-8a8d-4ee8be3e4606 req-86d020ed-d0e1-4e80-97f5-fca66d063d87 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0977466 May 25 15:41:55.173696 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:41:55.180488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:41:55.186318 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 1.8804176 May 25 15:41:55.212619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Request body: {'port': {'device_id': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:41:55.279531 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0e39e88e-a76a-4576-9749-70f933bf308c None None] Provisioning for port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:41:55.282359 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.288334 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0e39e88e-a76a-4576-9749-70f933bf308c None None] Provisioning complete for port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:41:55.288559 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.288686 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0e39e88e-a76a-4576-9749-70f933bf308c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.297860 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9b252ce7-f068-4635-a6f6-5f3e2f2ed072 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.344691 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.345283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-0e39e88e-a76a-4576-9749-70f933bf308c None None] Port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:41:55.360993 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4d7df3-ebf8-400c-84e3-d4c99e276cc5 req-9ad7d7e9-0672-4ee3-975e-ad78767ece90 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1997325 May 25 15:41:55.392240 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb3e7a79-2f9d-4e79-b599-67dab9ae31ee,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:55.399291 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=cd28631696804ee0ba8ebf70d79c9062&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4441910 May 25 15:41:55.402273 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.402954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43476) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:41:55.475566 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 req-761d111c-8f80-4a64-b327-c2c2087f3b25 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.476995 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 req-761d111c-8f80-4a64-b327-c2c2087f3b25 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 935 time: 0.1677098 May 25 15:41:55.486107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.528251 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.594613 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.601065 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-877a074a-1453-42f6-8455-0243171dfb0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.615177 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb3e7a79-2f9d-4e79-b599-67dab9ae31ee,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:55.620490 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:55.623552 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-fc9a3553-5596-4921-a646-c9f8c06f6ac9 req-15625aee-b4db-43f4-91dc-4ca689a31eca tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1358767 May 25 15:41:55.626812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.628802 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/cb3e7a79-2f9d-4e79-b599-67dab9ae31ee HTTP/1.1" status: 204 len: 168 time: 0.2229042 May 25 15:41:55.762592 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:55.771539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.792100 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Transition to ACTIVE for port object 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:41:55.801428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:55.805479 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:55.818580 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9370ee99-e57a-404d-ac67-e6dc5abf4708 req-0192503e-30fa-4908-abc8-0a8a06841a9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:55.826055 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9370ee99-e57a-404d-ac67-e6dc5abf4708 req-0192503e-30fa-4908-abc8-0a8a06841a9a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1004741 May 25 15:41:55.868960 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9370ee99-e57a-404d-ac67-e6dc5abf4708 req-1e6d717f-d24e-4ff7-b400-d088533fdde0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417240 May 25 15:41:55.962403 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device c536b9e5-ae17-4775-b209-71e6ec42122a details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:41:56.034124 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Pushing event updated for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:56.043275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.136598 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Attempting to bind port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:41:56.136928 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Attempting to bind port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:41:56.137258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Attempting to bind port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 on network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:56.140727 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:56.144666 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 on network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:41:56.145006 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Attempting to bind port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 on network 4fce4df0-5246-42d6-ba2e-1012d59d04c0 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:41:56.153405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 41, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:41:56.153848 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Checking segment: {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:41:56.154896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Bound using segment: {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:41:56.155379 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Bound port: 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d7df0a9-4395-4f15-afdc-06bc8dc43302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:41:56.156508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.209806 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'port_id': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'mac_address': 'fa:16:3e:b9:ec:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:41:56.261842 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:41:56.297452 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.321213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c536b9e5-ae17-4775-b209-71e6ec42122a {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:41:56.341311 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:41:56.348091 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.350364 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.428616 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:56.436825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.437169 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.437505 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.437833 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.438148 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.438638 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.439102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.441230 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.442462 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.442814 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.444263 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.444798 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:41:56.449392 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.479920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:41:56.485403 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:41:56.494436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.503852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:41:56.558808 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 req-9ca1c57e-3af2-4898-b67e-973ef0858d31 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.573777 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 req-9ca1c57e-3af2-4898-b67e-973ef0858d31 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 944 time: 0.2038536 May 25 15:41:56.612774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.613408 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:56.614827 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] 10.222.0.70 "PUT /v2.0/ports/0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 HTTP/1.1" status: 200 len: 1097 time: 1.4127553 May 25 15:41:56.615312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:41:56.655462 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Pushing event updated for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:41:56.662794 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ebd94380-0cfa-491a-9e47-61ac29fdcf20 req-4ee86dc9-2fdc-489c-94f9-8e3700a413e8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959804 May 25 15:41:56.663638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:41:56.770060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5', 'status': 'completed', 'code': 200} May 25 15:41:56.797476 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-40d37635-a62b-4a36-a4f8-b69568e077a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:56.798909 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-40d37635-a62b-4a36-a4f8-b69568e077a9 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=be5fb171d503440e86a06009ac0dceef&device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 1100 time: 0.1118944 May 25 15:41:56.804627 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:41:56.898704 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-79531f1d-50d2-4e7c-ab58-1bcc9700c98e service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.54&port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 HTTP/1.1" status: 200 len: 217 time: 0.0875423 May 25 15:41:57.033779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-57e8d4f9-9c70-44a6-bf0a-3e9dab9e2eee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.035846 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-57e8d4f9-9c70-44a6-bf0a-3e9dab9e2eee service neutron] 10.222.0.70 "GET /v2.0/subnets?id=935cff87-3f66-4e7b-bcf5-f2c231ee8848 HTTP/1.1" status: 200 len: 843 time: 0.0811341 May 25 15:41:57.056177 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-6fb98175-2918-4642-ab96-671c6e13893c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.056785 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-6fb98175-2918-4642-ab96-671c6e13893c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Synchronizing usage tracker for tenant:be5fb171d503440e86a06009ac0dceef on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:57.126146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-6fb98175-2918-4642-ab96-671c6e13893c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Unset dirty status for tenant:be5fb171d503440e86a06009ac0dceef on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:57.127503 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-6fb98175-2918-4642-ab96-671c6e13893c tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 947 time: 0.2277517 May 25 15:41:57.175889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-36ab0873-157f-491b-ba2d-b00aa3a12d93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.177542 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-36ab0873-157f-491b-ba2d-b00aa3a12d93 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4fce4df0-5246-42d6-ba2e-1012d59d04c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1301048 May 25 15:41:57.184232 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-d0415ec8-38b4-4b3d-bed1-6c06250c2128 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Synchronizing usage tracker for tenant:be5fb171d503440e86a06009ac0dceef on resource:security_group {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:41:57.276919 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-d0415ec8-38b4-4b3d-bed1-6c06250c2128 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Unset dirty status for tenant:be5fb171d503440e86a06009ac0dceef on resource:security_group {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:41:57.278066 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-47a51fa5-954d-41a2-a6c9-77392daaf8f0 req-d0415ec8-38b4-4b3d-bed1-6c06250c2128 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1424680 May 25 15:41:57.340112 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-4dc21ed8-579a-493b-89d8-261dd30f0c56 service neutron] 10.222.0.70 "GET /v2.0/networks/4fce4df0-5246-42d6-ba2e-1012d59d04c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1481717 May 25 15:41:57.479597 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2aeb8d6-43de-4f16-b521-75586aff00e6 req-fe108d7c-1f1f-4bb3-8a31-53783240bad5 service neutron] 10.222.0.70 "GET /v2.0/networks/4fce4df0-5246-42d6-ba2e-1012d59d04c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269703 May 25 15:41:57.617188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-66e59390-8114-409a-a956-2fbfebd690ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.618696 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-66e59390-8114-409a-a956-2fbfebd690ca service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=be5fb171d503440e86a06009ac0dceef&device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 1100 time: 0.0706503 May 25 15:41:57.761540 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-5c4cee9a-135e-435e-931f-40f5b16cee34 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:57.763608 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-5c4cee9a-135e-435e-931f-40f5b16cee34 service neutron] 10.222.0.70 "GET /v2.0/networks?id=4fce4df0-5246-42d6-ba2e-1012d59d04c0 HTTP/1.1" status: 200 len: 870 time: 0.1322916 May 25 15:41:57.851616 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-2e75efb0-2f7b-4f49-b708-ad70546444b2 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.54&port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 HTTP/1.1" status: 200 len: 217 time: 0.0751805 May 25 15:41:58.012919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 req-96359437-61ff-4159-9e26-e379b0c08351 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.014391 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 req-96359437-61ff-4159-9e26-e379b0c08351 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 944 time: 0.0923688 May 25 15:41:58.021488 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-ecae0367-27b8-45b7-abd8-cf1a0f373c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.022974 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-ecae0367-27b8-45b7-abd8-cf1a0f373c8e service neutron] 10.222.0.70 "GET /v2.0/subnets?id=935cff87-3f66-4e7b-bcf5-f2c231ee8848 HTTP/1.1" status: 200 len: 843 time: 0.1561358 May 25 15:41:58.061705 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8aab9ef7-2255-4b6d-aaa9-4763278a9871 req-6914c3ac-30c3-40ab-a0b5-98004f09be93 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417550 May 25 15:41:58.113543 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767cb392-e68e-4436-836e-f570868d57b4 req-4ad2f7d6-0799-4740-98e0-c1dc414898cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.115007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-4ad2f7d6-0799-4740-98e0-c1dc414898cf service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.1994505 May 25 15:41:58.135163 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30dfd875-dc01-4535-8ee5-d0c385647b1d req-d9b6661d-547b-42a5-85fb-2548471fbd97 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.136578 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-30dfd875-dc01-4535-8ee5-d0c385647b1d req-d9b6661d-547b-42a5-85fb-2548471fbd97 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1699862 May 25 15:41:58.339455 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-17b9dd8b-8377-4301-882e-7dbe270f6300 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.340952 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-17b9dd8b-8377-4301-882e-7dbe270f6300 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=4fce4df0-5246-42d6-ba2e-1012d59d04c0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.3015523 May 25 15:41:58.354823 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-30dfd875-dc01-4535-8ee5-d0c385647b1d req-ff02c101-368a-42fd-9140-f825eafa696d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1981246 May 25 15:41:58.466983 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11eff962-7568-428c-9f2c-c2b3d0556f1a req-eab1743e-a522-4e0a-b828-4e1588de138e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.468344 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11eff962-7568-428c-9f2c-c2b3d0556f1a req-eab1743e-a522-4e0a-b828-4e1588de138e tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 947 time: 0.0816689 May 25 15:41:58.475645 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767cb392-e68e-4436-836e-f570868d57b4 req-ceadffab-ad17-4d75-97e9-112d19c9a036 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.477167 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-ceadffab-ad17-4d75-97e9-112d19c9a036 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.3389671 May 25 15:41:58.521571 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11eff962-7568-428c-9f2c-c2b3d0556f1a req-a7705962-b615-4fca-b3db-254f626e1beb tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481975 May 25 15:41:58.570781 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-48a49543-5f39-4874-9d4f-d8c40c9f0806 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.0715621 May 25 15:41:58.623913 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-6cda6996-dcef-44a6-bac7-ee281ce2b73e service neutron] 10.222.0.70 "GET /v2.0/networks/4fce4df0-5246-42d6-ba2e-1012d59d04c0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2567773 May 25 15:41:58.719390 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-767cb392-e68e-4436-836e-f570868d57b4 req-cd665aac-5988-42da-b939-f19eabb12001 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:58.720857 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-cd665aac-5988-42da-b939-f19eabb12001 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.1363566 May 25 15:41:58.778617 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-48f817c5-1c18-4e06-b863-5f7ee2a06210 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0474885 May 25 15:41:58.898434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b6dafbc-4f5f-47e6-b99a-b09eaebcb5a2 req-2f963ca5-66d9-4adc-8c01-3c11be28cec3 service neutron] 10.222.0.70 "GET /v2.0/networks/4fce4df0-5246-42d6-ba2e-1012d59d04c0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2618935 May 25 15:41:58.944825 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-739d4f1f-c6c6-4d11-a449-7aeae2eee5cb service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1536207 May 25 15:41:59.098661 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-767cb392-e68e-4436-836e-f570868d57b4 req-f21f6bfd-4d5b-42f5-9bdd-c57c025f1c7a service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1302059 May 25 15:41:59.262908 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cc71a64-e550-4d26-898f-4ef4dc29b927 req-16d20640-1fc9-48fb-948b-ca11757a730f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.264376 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8cc71a64-e550-4d26-898f-4ef4dc29b927 req-16d20640-1fc9-48fb-948b-ca11757a730f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 944 time: 0.0917692 May 25 15:41:59.310319 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8cc71a64-e550-4d26-898f-4ef4dc29b927 req-637de160-35e6-4fee-a582-0a80e0a562ff tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401058 May 25 15:41:59.545733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271f5f5d-5d22-415e-9692-86b6d0903b0b req-85745490-14df-4fdd-b270-1b4ca500cca7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.547181 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-271f5f5d-5d22-415e-9692-86b6d0903b0b req-85745490-14df-4fdd-b270-1b4ca500cca7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0804400 May 25 15:41:59.591844 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-271f5f5d-5d22-415e-9692-86b6d0903b0b req-38ebbc49-b76d-4544-95a9-03a8c8f27873 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385745 May 25 15:41:59.730171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f req-95faeabc-abbc-4e84-8dfa-1d59a9317888 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:41:59.731815 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f req-95faeabc-abbc-4e84-8dfa-1d59a9317888 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 947 time: 0.0942857 May 25 15:41:59.778537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6c90f5a8-040a-4859-a36f-cd8062ffcc5f req-0db59d5c-6cd5-4ba1-a7f7-bfdec85685c2 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407336 May 25 15:41:59.971729 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-824682ca-74fa-4313-b923-e5b0c9d5ceb6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:41:59.991273 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:41:59.996212 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device c536b9e5-ae17-4775-b209-71e6ec42122a up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:00.121073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43576) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:00.191740 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port c536b9e5-ae17-4775-b209-71e6ec42122a completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:00.197968 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port c536b9e5-ae17-4775-b209-71e6ec42122a triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:00.198356 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.254431 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.269197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:00.273000 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Usage tracker for resource:security_group_rule and tenant:be320c0349064610974d9938c19a1b6f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:00.275761 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:00.281529 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:00.284111 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:00.302558 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5', 'network_id': '4fce4df0-5246-42d6-ba2e-1012d59d04c0', 'port_id': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5', 'mac_address': 'fa:16:3e:d8:4c:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 386, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '935cff87-3f66-4e7b-bcf5-f2c231ee8848', 'ip_address': '192.168.233.54'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:00.380673 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.386339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.394098 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.398509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-202a33da-146c-43cc-a430-5f13ad37e7d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.434072 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:00.455128 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.467804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:00.477185 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.480487 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.490060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=be320c0349064610974d9938c19a1b6f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3664811 May 25 15:42:00.491290 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 43588) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:00.494395 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de7b47bd-f729-4745-8f92-fdf4ef51db12,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.502541 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.545091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6247394-5339-4fae-95fc-208b2154a99c req-d9992250-09da-4026-9260-3f41a94b7b07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.546394 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:00.546622 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6247394-5339-4fae-95fc-208b2154a99c req-d9992250-09da-4026-9260-3f41a94b7b07 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 944 time: 0.1074610 May 25 15:42:00.563295 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:00.572281 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.584110 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.584777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.587688 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.588087 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.621679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.621893 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6247394-5339-4fae-95fc-208b2154a99c req-75728354-3025-424a-b539-9829b2164ce1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657456 May 25 15:42:00.645049 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'code': 200} May 25 15:42:00.664346 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.676582 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.700815 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.707004 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-391cedeb-6201-417b-9ade-b7777365b30b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:00.717581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de7b47bd-f729-4745-8f92-fdf4ef51db12,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:00.722208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:00.726940 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:00.730511 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/de7b47bd-f729-4745-8f92-fdf4ef51db12 HTTP/1.1" status: 204 len: 168 time: 0.2356670 May 25 15:42:00.852326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346511bb-91a8-496c-972b-a9670c38c446 req-82913eb2-30ee-42d3-8346-17e07d91dd4f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:00.859409 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-346511bb-91a8-496c-972b-a9670c38c446 req-82913eb2-30ee-42d3-8346-17e07d91dd4f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1077528 May 25 15:42:00.933487 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['0d049ba8-f49c-4e51-b70c-b3c7bcb786d5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:00.967938 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-346511bb-91a8-496c-972b-a9670c38c446 req-f83c65ee-5cc6-40ca-90da-8c94166829ac tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1074121 May 25 15:42:01.015326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6f0de8-57d3-48df-9974-1560f3c4b720 req-318f96b8-cfb2-49de-b8bc-f7979e428d2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.017062 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff6f0de8-57d3-48df-9974-1560f3c4b720 req-318f96b8-cfb2-49de-b8bc-f7979e428d2d service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1098 time: 0.1377561 May 25 15:42:01.048288 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf895200-9b99-43d6-95e6-435b3dd0377c req-d6e7ea28-aa31-434c-bd57-61840e3fa867 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.049858 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cf895200-9b99-43d6-95e6-435b3dd0377c req-d6e7ea28-aa31-434c-bd57-61840e3fa867 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 948 time: 0.1371219 May 25 15:42:01.068702 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff6f0de8-57d3-48df-9974-1560f3c4b720 req-8c06646a-7803-44b1-bab3-8f7f36ea8506 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418088 May 25 15:42:01.101877 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cf895200-9b99-43d6-95e6-435b3dd0377c req-e48412c6-d37b-4d23-9328-3b74823d423b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443206 May 25 15:42:01.810321 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 req-60472fb5-e4da-4216-bd65-a56f68631403 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:01.811799 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 req-60472fb5-e4da-4216-bd65-a56f68631403 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0872843 May 25 15:42:01.856280 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a4cab5c4-16e8-4ecc-9dc6-fcb7abde8ee8 req-81762e2e-385d-49ce-9e2b-6fc1d0161a4e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380187 May 25 15:42:02.178699 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d req-004e0c36-e6e3-488c-a1bc-e91ac5ebbfe7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.182692 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d req-004e0c36-e6e3-488c-a1bc-e91ac5ebbfe7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0872347 May 25 15:42:02.255490 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1b0b3a49-af6a-4ee1-b6f7-24646372e23d req-0bb5d1f5-a206-46d5-a914-ec93983bad65 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647748 May 25 15:42:02.337439 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54384d6c-b363-44d5-a6e6-4ba816af1e11 req-2bc0b747-2295-4dfa-bca0-9e4d584b4352 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:02.338920 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-54384d6c-b363-44d5-a6e6-4ba816af1e11 req-2bc0b747-2295-4dfa-bca0-9e4d584b4352 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 948 time: 0.0835445 May 25 15:42:02.387244 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-54384d6c-b363-44d5-a6e6-4ba816af1e11 req-46ccc099-9350-42a1-8ede-0a38dce42790 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418472 May 25 15:42:02.623944 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:02.672319 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3b3faf1b-a002-4ceb-8968-9594e612ccc9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.042936 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 req-184e6e7f-60a7-401e-b5cf-228235bf40e2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.044412 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 req-184e6e7f-60a7-401e-b5cf-228235bf40e2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0824656 May 25 15:42:03.087673 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ec92eaf-d89b-4bc2-8149-d2a44f950bc6 req-6d4eba32-fa0a-46fa-91a4-ce5c9c49a980 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377293 May 25 15:42:03.281022 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db7a1474-5c71-493c-9142-e390fe74a222 req-1695e1f9-8b7d-488d-9660-ed4baf88d5fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.281022 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-db7a1474-5c71-493c-9142-e390fe74a222 req-1695e1f9-8b7d-488d-9660-ed4baf88d5fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0792201 May 25 15:42:03.327725 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-db7a1474-5c71-493c-9142-e390fe74a222 req-da623c0f-a735-412c-8a70-983c9829d865 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403240 May 25 15:42:03.431835 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:03.451583 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c req-5486dfcc-ed8f-48af-a9d4-854b67dd4443 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.453148 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c req-5486dfcc-ed8f-48af-a9d4-854b67dd4443 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0897610 May 25 15:42:03.499585 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3ebb8008-cc2a-4ef1-9ec9-42d42a084f2c req-569e8e85-a2da-4c3f-ac0e-f6ff6a04c438 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400827 May 25 15:42:03.756106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f12263ec-1416-4235-9012-f0d42eb442e8 req-43eae348-c21b-4e56-ada8-63fddf1b5374 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.757578 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f12263ec-1416-4235-9012-f0d42eb442e8 req-43eae348-c21b-4e56-ada8-63fddf1b5374 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 948 time: 0.1431930 May 25 15:42:03.801612 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f12263ec-1416-4235-9012-f0d42eb442e8 req-1eff1314-c974-4bd1-aa31-5a53a7262a75 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382850 May 25 15:42:03.970987 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9201ab4a-1cd0-41d3-88ba-c669f18b688b req-999a3213-c5e9-42e8-94b1-1b7d16a021d8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:03.972503 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9201ab4a-1cd0-41d3-88ba-c669f18b688b req-999a3213-c5e9-42e8-94b1-1b7d16a021d8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.1535699 May 25 15:42:04.012978 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:04.016899 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9201ab4a-1cd0-41d3-88ba-c669f18b688b req-e776d491-fa95-4fe6-9b78-bb53aa90872f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387282 May 25 15:42:04.085682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:04.093202 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:04.093202 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.208693 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.236352 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:04.246503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:04.250128 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:04.252592 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:04.288556 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5', 'code': 200} May 25 15:42:04.320279 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:04.323407 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:04.582144 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bcc6d04-a5e6-4f77-90dd-2269ffdaed08 req-ddf2c21b-956b-441d-a55a-12ea34fc8adb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.583652 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bcc6d04-a5e6-4f77-90dd-2269ffdaed08 req-ddf2c21b-956b-441d-a55a-12ea34fc8adb service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 1102 time: 0.0783672 May 25 15:42:04.638752 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bcc6d04-a5e6-4f77-90dd-2269ffdaed08 req-22c2b2dd-ba83-49f8-b3cd-2be10387948e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435104 May 25 15:42:04.695043 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-903d0df3-e258-4ef7-80e3-97ccd9613263 req-83d17ab9-01df-4d5f-9e3c-ff3f53ac7815 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.696509 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-903d0df3-e258-4ef7-80e3-97ccd9613263 req-83d17ab9-01df-4d5f-9e3c-ff3f53ac7815 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0806737 May 25 15:42:04.740596 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-903d0df3-e258-4ef7-80e3-97ccd9613263 req-d8be9a47-ba5b-4a76-b243-d701d04e29e9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381141 May 25 15:42:04.989998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e req-65217fe4-e970-4425-974d-78050a286f9f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:04.991586 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e req-65217fe4-e970-4425-974d-78050a286f9f tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.0812492 May 25 15:42:05.036465 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b0d8d401-beb9-41c4-a6b3-ad87a6b4d67e req-e90a3038-4fc3-4c88-baf7-a73850d94785 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392313 May 25 15:42:05.146684 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:05.922024 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-dbaee59c-9679-4ef6-8d9a-74851833531d service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0811222 May 25 15:42:05.928643 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 req-4ffaef78-0447-4522-af44-02162af4aa95 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:05.930102 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 req-4ffaef78-0447-4522-af44-02162af4aa95 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0835700 May 25 15:42:05.992672 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ec14209c-ab57-46d7-833f-0db4e86ce0f9 req-60d3ede7-8fe0-46cf-9f47-910295a820cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549312 May 25 15:42:06.036505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-e87d4089-1f41-4516-b1db-01e32980a118 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.038110 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-e87d4089-1f41-4516-b1db-01e32980a118 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.0805695 May 25 15:42:06.282460 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-67a470fa-1f31-4649-85ba-f52035b7ed1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.283963 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-67a470fa-1f31-4649-85ba-f52035b7ed1b service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.1849940 May 25 15:42:06.395145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef req-18e1722f-1a30-49c1-af55-1e170cfc6b1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.396744 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef req-18e1722f-1a30-49c1-af55-1e170cfc6b1a tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.1918380 May 25 15:42:06.432226 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-a2ee2517-c8f2-4409-a5e2-99c3e04d7798 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1001 time: 0.1317360 May 25 15:42:06.498046 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1ff7e873-decd-4aa9-b4a7-ced0eb8bc9ef req-942a4185-dbe3-422a-bb0b-6167e38db48b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918267 May 25 15:42:06.524870 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-5726739f-f7df-489b-a57e-a5ffa1429b29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.526611 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-5726739f-f7df-489b-a57e-a5ffa1429b29 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0736358 May 25 15:42:06.655967 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-e0b523b6-1481-4808-87ab-6d191e139ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:06.657451 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-e0b523b6-1481-4808-87ab-6d191e139ec8 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0883896 May 25 15:42:06.796720 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-519c62c2-47e9-4dcf-9a92-759035ee002b service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262336 May 25 15:42:06.943100 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aee17a2a-d47f-4278-b18c-d0321f9522c6 req-ab7eb774-38f4-459b-a0cb-1edeb7e5d112 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248441 May 25 15:42:07.176794 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035f3e84-f83d-41cc-9b9e-5a3047afd420 req-c279a514-7eb1-4a16-a5c0-79bcaa99b6cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.178294 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-035f3e84-f83d-41cc-9b9e-5a3047afd420 req-c279a514-7eb1-4a16-a5c0-79bcaa99b6cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0803530 May 25 15:42:07.223375 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-035f3e84-f83d-41cc-9b9e-5a3047afd420 req-c48208f6-ad10-4114-a10a-5b4c399eeb50 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392017 May 25 15:42:07.725652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 req-61656cd6-0986-4bfd-9329-a536ed7059bf tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:07.727117 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 req-61656cd6-0986-4bfd-9329-a536ed7059bf tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.0898137 May 25 15:42:07.772365 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-320576fb-95f4-4ae9-8834-0bbbc1d89f04 req-b66778c0-5c7a-4741-b909-6e90ee9cfe75 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389309 May 25 15:42:08.219459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf44e5dc-6e2b-4911-8203-3cca29adad57 req-023a2ce5-04ba-485f-af4c-ec323d87cd2b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.220936 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bf44e5dc-6e2b-4911-8203-3cca29adad57 req-023a2ce5-04ba-485f-af4c-ec323d87cd2b tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.0784614 May 25 15:42:08.267696 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bf44e5dc-6e2b-4911-8203-3cca29adad57 req-2715a162-6380-4f63-99da-19f80198b5ed tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406499 May 25 15:42:08.409175 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52537bc0-3288-4d68-8d4c-71026a49b7f9 req-f1bdd8b8-c1f0-4253-99d6-bd45bb570e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:08.411208 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-52537bc0-3288-4d68-8d4c-71026a49b7f9 req-f1bdd8b8-c1f0-4253-99d6-bd45bb570e67 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0797508 May 25 15:42:08.458172 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-52537bc0-3288-4d68-8d4c-71026a49b7f9 req-05ddf436-58af-405a-be31-39339f3c8b3b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415492 May 25 15:42:09.458553 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e req-975d8711-ae3c-4510-bee8-4093afbf9cac tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:09.460320 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e req-975d8711-ae3c-4510-bee8-4093afbf9cac tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.0813346 May 25 15:42:09.505542 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a31bf896-2764-47c2-9cbd-17a6aeb7c75e req-267d52f3-fdd1-4e19-ade9-02abcce37537 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395553 May 25 15:42:09.683275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb30f65-6037-4a5e-9d09-4bff62252a31 req-018a6445-abb1-43e0-b537-05c30e5bf9af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:09.684837 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3cb30f65-6037-4a5e-9d09-4bff62252a31 req-018a6445-abb1-43e0-b537-05c30e5bf9af tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0845323 May 25 15:42:09.730905 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3cb30f65-6037-4a5e-9d09-4bff62252a31 req-39bc750a-8be0-401e-8204-bcd75ea86254 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391753 May 25 15:42:10.587751 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:10.694581 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 req-693463bf-3167-4e7a-9d9f-b21b5b1b50fe tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:10.696087 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 req-693463bf-3167-4e7a-9d9f-b21b5b1b50fe tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.0833561 May 25 15:42:10.741914 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0a49ce33-0491-4229-afb0-7c7dd6a055a4 req-c0bb308c-f5ad-4cdf-9a78-94802c85b1b3 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/security-groups?id=9ba7386a-c9ab-4128-9d00-1c68e2bac39a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392992 May 25 15:42:11.065856 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772b849a-c88c-44ae-b46d-4bf9c0035d8f req-04f19a9c-5b53-4ffb-a196-f615a363478e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:11.067298 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-772b849a-c88c-44ae-b46d-4bf9c0035d8f req-04f19a9c-5b53-4ffb-a196-f615a363478e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2263932 May 25 15:42:11.075358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-38e9be61-cca1-41bc-af4d-6823d08b61ff tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:11.076720 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-38e9be61-cca1-41bc-af4d-6823d08b61ff tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.70 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 949 time: 0.1136680 May 25 15:42:11.168920 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-772b849a-c88c-44ae-b46d-4bf9c0035d8f req-b63456cc-1530-4766-8b44-d3b7dab2b502 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912516 May 25 15:42:11.245783 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Deleting port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:42:11.246125 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.383022 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] For port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,segment=NetworkSegment(7d7df0a9-4395-4f15-afdc-06bc8dc43302),segment_id=7d7df0a9-4395-4f15-afdc-06bc8dc43302)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:11.383389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.508361 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Calling delete_port for 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:42:11.616601 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.622388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:11.635896 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['0d049ba8-f49c-4e51-b70c-b3c7bcb786d5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:11.669808 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Pushing event deleted for resources: {'Port': ['ID=0d049ba8-f49c-4e51-b70c-b3c7bcb786d5,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:11.684859 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:11.765623 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] No DVR routers for this DVR port 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:42:11.769067 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:11.772004 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'name': 'network-vif-deleted', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:11.796368 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f55425f-a533-4aaf-aa73-4c95d4cc270b req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.70 "DELETE /v2.0/ports/0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 HTTP/1.1" status: 204 len: 173 time: 0.7045877 May 25 15:42:11.852549 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9cefa816-94bd-4b6c-ba1e-c71f7b539bf3', 'name': 'network-vif-deleted', 'tag': '0d049ba8-f49c-4e51-b70c-b3c7bcb786d5', 'status': 'completed', 'code': 200} May 25 15:42:11.933588 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 req-8041afc8-467e-409e-bff5-4be2512ecf15 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Synchronizing usage tracker for tenant:be5fb171d503440e86a06009ac0dceef on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:11.952351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 req-8041afc8-467e-409e-bff5-4be2512ecf15 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Unset dirty status for tenant:be5fb171d503440e86a06009ac0dceef on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:11.953559 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bf97b8f2-368f-4a7f-a44b-360c30ce6284 req-8041afc8-467e-409e-bff5-4be2512ecf15 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] 10.222.0.36 "GET /v2.0/ports?device_id=9cefa816-94bd-4b6c-ba1e-c71f7b539bf3 HTTP/1.1" status: 200 len: 210 time: 0.0767429 May 25 15:42:12.366787 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d27355e-1e77-48a6-8c76-059ee38eb647 req-20cd63ff-acd5-4424-b513-e806a6cf1e36 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:12.368308 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1d27355e-1e77-48a6-8c76-059ee38eb647 req-20cd63ff-acd5-4424-b513-e806a6cf1e36 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0851834 May 25 15:42:12.414275 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1d27355e-1e77-48a6-8c76-059ee38eb647 req-48129733-ca79-4877-b9f0-b8f1e4671fa3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402248 May 25 15:42:13.620915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26b6b859-55d3-4cfd-b96c-c831f750478f req-4e925fe1-974c-49cd-bce8-68e36e9430fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:13.622682 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-26b6b859-55d3-4cfd-b96c-c831f750478f req-4e925fe1-974c-49cd-bce8-68e36e9430fc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0898590 May 25 15:42:13.671475 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-26b6b859-55d3-4cfd-b96c-c831f750478f req-2359c7be-3ac8-4a07-a997-0377df81507c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420370 May 25 15:42:14.088340 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:42:14.123238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:42:14.123593 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 0d049ba8-f49c-4e51-b70c-b3c7bcb786d5 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:42:14.643008 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be2202da-dbd9-4d35-8e3f-147d096eb91b req-786f11e4-9ed4-4c97-a439-c49459e82014 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.645172 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be2202da-dbd9-4d35-8e3f-147d096eb91b req-786f11e4-9ed4-4c97-a439-c49459e82014 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0836837 May 25 15:42:14.697956 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be2202da-dbd9-4d35-8e3f-147d096eb91b req-293e9613-0fae-4c6e-8a27-2674a6b092a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456316 May 25 15:42:14.721121 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43924) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:14.896664 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b req-37a6560f-611d-4435-81a2-36cca139879f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:14.898819 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b req-37a6560f-611d-4435-81a2-36cca139879f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1088376 May 25 15:42:14.999828 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1764641d-295e-4a6b-8afb-8c8d4ac0fd4b req-118e15c2-5b6a-4dc3-95fe-231badd0184e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0909662 May 25 15:42:15.027454 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb52813d-428d-4930-91c8-1976986069e5 tempest-TestMinimumBasicScenario-142620287 tempest-TestMinimumBasicScenario-142620287-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:15.031583 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-eb52813d-428d-4930-91c8-1976986069e5 tempest-TestMinimumBasicScenario-142620287 tempest-TestMinimumBasicScenario-142620287-project-admin] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1093 time: 0.3059754 May 25 15:42:15.031802 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 43950) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:15.037059 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'port_id': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'fixed_ip_address': '172.20.0.5'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:15.042934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:15.046824 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:floatingip and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:15.049683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:15.056241 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:15.067960 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.215781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.371131 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Allocated IP 172.27.0.74 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/32450a42-190a-4cf4-bf2d-3860fafab442) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:15.610964 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.642243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:15.647319 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:15.714641 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:15.717546 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:15.721299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:15.763210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'Port': ['ID=32450a42-190a-4cf4-bf2d-3860fafab442,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:15.778033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.157931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:16.221996 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092404bb-eb63-4226-bd0c-15a297d71b7a req-ed5fa1cd-c807-4cf8-9b00-7740b52bec9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:16.223300 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-092404bb-eb63-4226-bd0c-15a297d71b7a req-ed5fa1cd-c807-4cf8-9b00-7740b52bec9c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0959496 May 25 15:42:16.248262 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:16.297728 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-092404bb-eb63-4226-bd0c-15a297d71b7a req-d5c1d23a-1d3a-4943-ada7-4dce8ba43f35 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666511 May 25 15:42:16.486910 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71f26d05-7fb5-45bf-9425-3e6ce0accbbc req-7e7cb2d9-497c-46e7-b07e-8cc248934ee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:16.488590 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-71f26d05-7fb5-45bf-9425-3e6ce0accbbc req-7e7cb2d9-497c-46e7-b07e-8cc248934ee1 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.1813736 May 25 15:42:16.564411 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-71f26d05-7fb5-45bf-9425-3e6ce0accbbc req-a19de6bf-b92b-4c14-92ea-c2129abce67b service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560954 May 25 15:42:16.579348 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:16.584811 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:16.589380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:16.698644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'Port': ['ID=32450a42-190a-4cf4-bf2d-3860fafab442,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:16.708955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:16.758188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:16.887604 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Floating IP 1a4342da-ab04-4564-8557-72bc8ff2e735 associated. External IP: 172.27.0.74, port: c536b9e5-ae17-4775-b209-71e6ec42122a. May 25 15:42:17.326614 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Router 39dd6c05-7a84-4acc-a23b-40de52e09655 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:42:17.554947 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:17.564773 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Sync routers for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:17.574895 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:17.575542 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:17.591314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496a97be-d949-4e15-bbd3-54588340acd4 req-af25fbe2-11d5-4c63-8484-41eb93f3015d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:17.592726 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-496a97be-d949-4e15-bbd3-54588340acd4 req-af25fbe2-11d5-4c63-8484-41eb93f3015d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1830664 May 25 15:42:17.593589 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.678983 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-496a97be-d949-4e15-bbd3-54588340acd4 req-9102b886-90c9-4119-98fa-7a348c9b2887 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618453 May 25 15:42:17.683275 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.6477976 May 25 15:42:17.683275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:17.684574 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44032) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:17.705236 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-322049059', 'description': 'tempest-secgroup-smoke-322049059 description', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:17.728498 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:17.739792 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:17.755317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.771332 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:17.809590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:17.814234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:17.818838 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:17.823060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:42:17.827076 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:17.941011 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.949489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:17.955673 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e2823ee7-d440-4272-8bec-6ad41a31a22e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:17.985891 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-aedc81b8-9623-4538-a2ad-8f03b99642e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:17.987741 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-aedc81b8-9623-4538-a2ad-8f03b99642e7 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1098 time: 0.1172478 May 25 15:42:18.003948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroup': ['ID=17501c6a-8302-4871-b31d-a8c482336d39,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.007790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.012349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.017519 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.3285501 May 25 15:42:18.020538 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44044) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.033544 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.040337 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:18.045175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:18.048526 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:18.056017 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:18.076625 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.167959 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44050) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.175660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.182089 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.185060 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ceca0938-a746-4d1c-8724-d1dcf216a3e6 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.220856 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-1822a059-5165-4fd3-856b-5b7751eb9385 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.222156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eec09c37-079a-458a-a9f6-8b179bd29a46,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.222599 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-1822a059-5165-4fd3-856b-5b7751eb9385 service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.2210839 May 25 15:42:18.231395 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.236087 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.241040 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-414ee225-3e23-489d-a3b7-2888af7662a2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2137108 May 25 15:42:18.241722 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44056) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.254971 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.262932 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:18.267937 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:18.272670 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:18.282560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:18.291886 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1a4342da-ab04-4564-8557-72bc8ff2e735', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'floating_ip_address': '172.27.0.74', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'port_id': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 371, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'mac_address': 'fa:16:3e:b9:ec:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17e39efa-e568-41dd-9368-376ead8b1020', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:42:16Z', 'updated_at': '2021-05-25T15:42:16Z', 'revision_number': 0, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:18.300750 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Checking router: 39dd6c05-7a84-4acc-a23b-40de52e09655 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:18.307577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.319316 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:18.320206 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:18.381232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.389438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.391816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.401292 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-3f03cac3-031f-4e86-a1c3-cb7b4a7eacd4 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 998 time: 0.1626065 May 25 15:42:18.410621 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=270ed9a8-d4fe-43d0-84da-89e7427b8367,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.410887 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e27dbea4-b926-4e4f-9827-21f33f8dd84c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=be5fb171d503440e86a06009ac0dceef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2414818 May 25 15:42:18.413306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44064) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.420313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.439082 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.440446 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1950443 May 25 15:42:18.443701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44070) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.449139 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.455342 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:18.459812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:18.463511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:18.470641 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:18.493412 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.516913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-e77cd592-1271-4312-af47-f23eeb0b5ac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.518567 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-e77cd592-1271-4312-af47-f23eeb0b5ac2 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0890009 May 25 15:42:18.529585 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:18.532742 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.568593 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.574307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.576875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.600344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30dfea89-71c6-4fdf-9251-fff37e417407,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.602870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.611968 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.616599 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6b8c695a-339e-495d-99fa-e9e9d639c060 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1687582 May 25 15:42:18.616853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44078) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.620761 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.622701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.628429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:18.636156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:18.639119 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:18.645074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:18.662681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.679120 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-0d611539-5a40-4e5c-8a03-df71a26eb4fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:18.680638 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-0d611539-5a40-4e5c-8a03-df71a26eb4fd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1327732 May 25 15:42:18.693524 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.698716 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-285510df-514b-41c0-b2ba-03188660f729 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.744145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ba7386a-c9ab-4128-9d00-1c68e2bac39a,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.747094 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.748429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.755752 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.766189 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1e1cd11b-b517-4378-a7ca-c9bee61486db tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:18.799380 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c4de026-aba8-4553-993d-2a6803e34dc7,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:18.803581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:18.808491 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.809993 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1920733 May 25 15:42:18.813216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44084) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:18.826578 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:18.837608 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:18.842681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:18.845033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.846466 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/9ba7386a-c9ab-4128-9d00-1c68e2bac39a HTTP/1.1" status: 204 len: 168 time: 0.4321256 May 25 15:42:18.847029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:18.856534 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:18.871001 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.securitygroups_db [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Project 55dc60a2768e4d2db35d44c21ff0e0a6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:42:18.880396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.908742 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-99fcd119-b758-4958-b53e-727ff0a035b6 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1992180 May 25 15:42:18.989701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:18.999093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.001439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-575d07be-4674-441b-82e0-a706412bef7c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.057205 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.061515 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2459528 May 25 15:42:19.062434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=194e9b3a-419e-4119-ab92-3f0d8a4d36bd,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:19.064251 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44098) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:19.069459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-7c9d451f-4eb4-4854-a4e4-36a28c18125b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.077574 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'security_group_rule': {'security_group_id': '17501c6a-8302-4871-b31d-a8c482336d39', 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:19.092670 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:19.094453 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1a4342da-ab04-4564-8557-72bc8ff2e735', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'floating_ip_address': '172.27.0.74', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'port_id': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 371, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'mac_address': 'fa:16:3e:b9:ec:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17e39efa-e568-41dd-9368-376ead8b1020', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:42:16Z', 'updated_at': '2021-05-25T15:42:16Z', 'revision_number': 0, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:19.102658 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea179b2-0123-40e4-83a1-b1073ca5c875 None None] The sync data for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi is: [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1a4342da-ab04-4564-8557-72bc8ff2e735', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'floating_ip_address': '172.27.0.74', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'port_id': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 371, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'mac_address': 'fa:16:3e:b9:ec:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '17e39efa-e568-41dd-9368-376ead8b1020', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:42:16Z', 'updated_at': '2021-05-25T15:42:16Z', 'revision_number': 0, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:19.104424 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Usage tracker for resource:security_group_rule and tenant:55dc60a2768e4d2db35d44c21ff0e0a6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:19.123637 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:19.132333 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:19.153902 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.securitygroups_db [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Project 55dc60a2768e4d2db35d44c21ff0e0a6 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:42:19.162940 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.172558 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-75ac9626-3688-4a4d-b698-2e8b90e87fc9 req-63841d27-6915-45e7-99cf-ad61924ed1df service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2419741 May 25 15:42:19.246027 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.250579 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.253107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:19.270694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488d19c0-c25a-480a-8373-81b760e906bd req-d88d7999-3d4d-4d51-bd0f-c7a96adc52f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:19.272197 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-488d19c0-c25a-480a-8373-81b760e906bd req-d88d7999-3d4d-4d51-bd0f-c7a96adc52f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0986295 May 25 15:42:19.295202 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f3b30d2a-f918-4e8a-8e1d-c76277e1806c,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:19.297507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.300329 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2351050 May 25 15:42:19.304072 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-65eec98c-67d9-4c31-814e-0b5e02c83ba9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:19.321806 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-488d19c0-c25a-480a-8373-81b760e906bd req-1b712f04-e89b-4b73-8d3c-b191a3e1b478 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438104 May 25 15:42:19.445614 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a8eca4e-b573-4314-988f-7146aa77d668 None None] New status for floating IP 1a4342da-ab04-4564-8557-72bc8ff2e735: ACTIVE {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:42:19.461509 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-9cfa25eb-0882-4191-a9e3-793df5f0ff7f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:19.481948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-9cfa25eb-0882-4191-a9e3-793df5f0ff7f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:19.483509 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-9cfa25eb-0882-4191-a9e3-793df5f0ff7f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-322049059&fields=id&tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6 HTTP/1.1" status: 200 len: 267 time: 0.0761030 May 25 15:42:19.579033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-ca970f7f-c6cc-4948-849f-8cab7390bfde tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:19.580671 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-ca970f7f-c6cc-4948-849f-8cab7390bfde tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0912824 May 25 15:42:19.594204 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'port': {'security_groups': ['f277e78b-c576-4ffa-b9c2-0ae2856bc3cc', '17501c6a-8302-4871-b31d-a8c482336d39']}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:19.772795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-a5e2fa81-56c4-4701-9fe9-5e38b956b5f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:19.774756 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-a5e2fa81-56c4-4701-9fe9-5e38b956b5f1 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.0908701 May 25 15:42:19.786058 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:19.909960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44130) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:20.037539 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-126237461-network', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:20.045870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:20.062118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Usage tracker for resource:network and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:20.067149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:20.077376 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:20.099221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-71e400ef-98e0-4738-a515-142672ba0927 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.100766 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:20.100933 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-71e400ef-98e0-4738-a515-142672ba0927 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.3119206 May 25 15:42:20.104878 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Made reservation on behalf of 8dff1003ceba47f6a75b4c3901343b7b for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:20.107154 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.114516 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db0ce55-8a33-4569-b71e-12fe46034711 req-0c1d261d-261c-4241-af70-0d04ccc6fd7b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.117171 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2db0ce55-8a33-4569-b71e-12fe46034711 req-0c1d261d-261c-4241-af70-0d04ccc6fd7b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1335859 May 25 15:42:20.122145 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.141270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:20.154386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:20.158423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:20.162209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.167076 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:20.170511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.183361 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9f26144f-04e9-4d47-8fda-242acd3a8e3b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.187191 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:20.211310 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-127aa7cc-954f-46c5-9222-3be1fd89dd4e service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.0719454 May 25 15:42:20.237710 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2db0ce55-8a33-4569-b71e-12fe46034711 req-2b31d00a-966a-45c6-a053-7bea07b895d3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1151524 May 25 15:42:20.269234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.269898 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for port, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.271290 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-58a6d3de-76f5-4ca5-bfcc-0eede9fceaa9 req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "PUT /v2.0/ports/c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 981 time: 0.6825404 May 25 15:42:20.271792 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:20.310889 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=6']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:20.315828 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.320665 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-1cf0eb1f-2962-48b6-a40d-76da1b6e796f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.322002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-1cf0eb1f-2962-48b6-a40d-76da1b6e796f service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.0882590 May 25 15:42:20.427138 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-88200e22-fd92-44a7-890b-76c45d8ce5a2 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0822158 May 25 15:42:20.459323 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:20.537186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.540645 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:42:20.545716 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.554509 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-93c18e1c-baeb-4125-b617-be3b937dec80 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.596106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 377} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:20.605578 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3c73ab0-a444-4461-afee-53ef51154a1c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:20.609256 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.612137 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.612564 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Added segment bbec2705-fa86-48c1-842e-d80e8691ed54 of type vlan for network d8a04926-b628-40fa-a53b-51df7783813d May 25 15:42:20.644925 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.678252 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.679743 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.680345 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.685138 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:20.702752 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-e9c54643-40ce-47bd-8ad3-504c1fb19e32 None None] Provisioning complete for port c536b9e5-ae17-4775-b209-71e6ec42122a triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:20.703369 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-e9c54643-40ce-47bd-8ad3-504c1fb19e32 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:20.770831 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-5fa88d22-2b07-4542-ac46-13b7a0e4fd1c service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3116555 May 25 15:42:20.777515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-306656e0-abe2-4d23-915b-5ff369c08f00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.779043 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-306656e0-abe2-4d23-915b-5ff369c08f00 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1137 time: 0.2957587 May 25 15:42:20.790506 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Pushing event updated for resources: {'Network': ['ID=d8a04926-b628-40fa-a53b-51df7783813d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:20.792911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 req-f24371c9-271b-4c8a-8774-8b05db21d8e6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:20.794523 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 req-f24371c9-271b-4c8a-8774-8b05db21d8e6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.2291837 May 25 15:42:20.799079 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.8877969 May 25 15:42:20.800340 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:20.802084 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44144) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:20.812201 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Request body: {'subnet': {'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-126237461-subnet', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:20.819593 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:20.824188 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Usage tracker for resource:subnet and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:20.827285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:20.834089 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:20.834480 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network d8a04926-b628-40fa-a53b-51df7783813d details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:20.849557 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Made reservation on behalf of 8dff1003ceba47f6a75b4c3901343b7b for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:20.852797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.034847 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-82e5aa41-4cf0-4bd3-ac18-82b7975f3424 req-e49af087-dc14-4b79-b1dc-691c640839c5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1859798 May 25 15:42:21.115119 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f725b22a-abb5-493c-8a31-ff5a816dcc86 req-59555791-f8d2-4d46-9c91-2c48ddd2f665 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3166358 May 25 15:42:21.116488 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-55e1680b-bc13-4eea-97a9-6f5b874156e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.117920 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-55e1680b-bc13-4eea-97a9-6f5b874156e5 service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.2920463 May 25 15:42:21.273239 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-68ae2662-f71d-44f3-9e7b-352b662da142 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 1000 time: 0.1237898 May 25 15:42:21.334508 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.341558 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0cdeb4e4-2300-4c66-a8a3-57e831399e44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:21.360576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-e0977067-ef4d-4a81-be67-9eea095e099b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.362011 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-e0977067-ef4d-4a81-be67-9eea095e099b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0601029 May 25 15:42:21.457346 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-d82e418e-c93e-4da5-84ab-c20da62d2248 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.458903 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-d82e418e-c93e-4da5-84ab-c20da62d2248 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0753164 May 25 15:42:21.461148 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Pushing event updated for resources: {'Subnet': ['ID=693414b7-eaf3-4626-b7cd-b644e55f5f70,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:21.463868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:21.478469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:21.478826 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Network hostable DHCP agents. Network: d8a04926-b628-40fa-a53b-51df7783813d, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:21.505567 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Network d8a04926-b628-40fa-a53b-51df7783813d is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:21.517400 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, d8a04926-b628-40fa-a53b-51df7783813d) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:21.527138 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-586d3ed6-4c7d-4e30-b1a1-cb15a933befa None None] Network d8a04926-b628-40fa-a53b-51df7783813d requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:21.528948 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.529544 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.542734 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f326ff07-3918-4588-baa1-c68beaee0df8 req-049f8f77-bbf9-422d-b606-aa4f3ac43292 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:21.544267 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f326ff07-3918-4588-baa1-c68beaee0df8 req-049f8f77-bbf9-422d-b606-aa4f3ac43292 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1448650 May 25 15:42:21.592653 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-86b9ed9f-55e3-43f9-b05b-6a8c0400a678 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.7892859 May 25 15:42:21.595793 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44158) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:21.603982 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:21.610618 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:21.615206 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f326ff07-3918-4588-baa1-c68beaee0df8 req-cc6a8901-9787-4b2a-88f0-ea8bdec3ab8a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653696 May 25 15:42:21.617569 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Usage tracker for resource:router and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:21.621085 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:21.627447 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:21.639397 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.640649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.655800 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-4e03821f-b397-48da-9078-dcc277210797 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1815445 May 25 15:42:21.661303 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.758623 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-d8a04926-b628-40fa-a53b-51df7783813d', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:42:21.759555 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:21.935142 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Allocated IP 172.20.0.2 (d8a04926-b628-40fa-a53b-51df7783813d/693414b7-eaf3-4626-b7cd-b644e55f5f70/12fb5763-2454-41d1-b8b5-dc1bb2189f3d) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:21.938934 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-312a1ca9-8500-4ae7-9d2a-759fd6067712 req-1e9f25f9-f79a-4f70-a5ae-4b21ced223bd service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2473938 May 25 15:42:21.960145 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.144887 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.157615 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Transition to ACTIVE for port object 12fb5763-2454-41d1-b8b5-dc1bb2189f3d will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:22.176996 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Transition to ACTIVE for port object 12fb5763-2454-41d1-b8b5-dc1bb2189f3d will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:22.182645 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.186006 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-38149da2-5330-4bc7-8b01-de2099f26e41 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.252302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:22.255436 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:22.258958 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:22.264998 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Pushing event updated for resources: {'Port': ['ID=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:22.269219 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.278024 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.358888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Attempting to bind port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:22.359271 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Attempting to bind port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:22.359678 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Attempting to bind port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:22.367646 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:22.368079 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:22.368522 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.368925 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Bound using segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:22.369406 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Bound port: 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:22.369786 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.398992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.460589 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] For port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:22.463546 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] For port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:22.467795 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.472304 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.538034 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Allocated IP 172.27.0.107 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:22.551296 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Pushing event updated for resources: {'Port': ['ID=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:22.556703 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.695485 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.733670 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:22.737972 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:22.821459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:22.826458 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:22.832378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:22.848418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52988a0-4840-41de-817b-7c1795a06111 req-9cf33220-f2d8-41a4-b256-f0a0e42eb59e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:22.850342 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a52988a0-4840-41de-817b-7c1795a06111 req-9cf33220-f2d8-41a4-b256-f0a0e42eb59e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1224523 May 25 15:42:22.862875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Pushing event updated for resources: {'Port': ['ID=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:22.869912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:22.904500 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a52988a0-4840-41de-817b-7c1795a06111 req-8d3c780e-5e10-48ff-88c9-365532d6a7f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476768 May 25 15:42:23.279666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:23.280429 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 12fb5763-2454-41d1-b8b5-dc1bb2189f3d up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:23.355161 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:23.550404 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce3d4820-6503-4902-bcea-62616b5dc9be None None] Network d8a04926-b628-40fa-a53b-51df7783813d requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:23.643269 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:23.655894 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Provisioning for port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:23.668045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Provisioning complete for port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:23.668358 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:23.918613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:23.937705 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Router 96a94b7a-1c97-4304-a42c-09cef968898f is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:42:23.966067 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] For port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:23.974110 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:23.975871 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8ad4bc7c-85e2-4893-bb77-2ba16164273e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:24.064200 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Pushing event updated for resources: {'Port': ['ID=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:24.068378 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:24.122189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 req-7bcc3ac9-25f2-4911-949a-91b5fede358c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:24.124017 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 req-7bcc3ac9-25f2-4911-949a-91b5fede358c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0899723 May 25 15:42:24.146688 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:24.156372 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:24.167449 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:24.168275 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:24.177001 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:24.177182 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-911bfde9-5c99-4c16-b12f-a2cd07ff09d7 req-84991c1b-6bfe-427a-b452-897d8a2d1350 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468774 May 25 15:42:24.178399 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.5816572 May 25 15:42:24.181161 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44182) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:24.203432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-49e2a535-461f-4781-ba72-642999b8e3c6 None None] Provisioning complete for port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:24.203804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-49e2a535-461f-4781-ba72-642999b8e3c6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:24.360311 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:24.679562 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:23Z', 'revision_number': 3, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:24.683487 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:24.683831 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Updating router 96a94b7a-1c97-4304-a42c-09cef968898f port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:42:24.759092 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:24.983962 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.250250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 12fb5763-2454-41d1-b8b5-dc1bb2189f3d up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:25.258837 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.274358 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Transition to ACTIVE for port object 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:25.282053 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.292655 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:25.361105 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Allocated IP 172.20.0.1 (d8a04926-b628-40fa-a53b-51df7783813d/693414b7-eaf3-4626-b7cd-b644e55f5f70/f20d30cd-8fa6-4272-bdec-eea7e76d7cf3) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:25.402890 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:25.403435 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.431720 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Attempting to bind port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:25.432201 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Attempting to bind port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:25.432858 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Attempting to bind port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:25.458365 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Pushing event updated for resources: {'Port': ['ID=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,revision_number=2']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:25.462035 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:25.462419 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:25.463069 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.463474 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:25.464311 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Bound port: 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:25.464694 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.525239 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.525587 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.525921 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.526398 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.527021 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.527347 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.528253 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.528626 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.528976 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.529300 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.529621 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.530108 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:25.535495 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:25.581968 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] For port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:25.585625 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] For port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:25.591315 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.596205 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-50982719-104f-418b-9385-ba64ec0ad2db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:25.601396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc9f113-ef34-4102-9217-ae89b965443a req-f5266ccb-500d-46b2-8b74-d28258e9e218 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:25.603326 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-adc9f113-ef34-4102-9217-ae89b965443a req-f5266ccb-500d-46b2-8b74-d28258e9e218 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1480670 May 25 15:42:25.646185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.678370 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Transition to ACTIVE for port object f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:25.681924 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-adc9f113-ef34-4102-9217-ae89b965443a req-dc963e9b-c110-4447-9343-a19b1f5a2620 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725543 May 25 15:42:25.694117 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:25.694790 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:25.723327 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:25.723327 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:25.784694 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Pushing event updated for resources: {'Port': ['ID=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:25.790107 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:25.848475 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:25.862489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:25.873049 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:25.909264 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:26.057225 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Pushing event updated for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:26.072528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.354s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:26.085982 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.154446 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-518b0382-ea5d-4450-9e20-623c2d55a2e2 None None] Provisioning for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:26.159421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-518b0382-ea5d-4450-9e20-623c2d55a2e2 None None] Provisioning complete for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:26.160608 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-518b0382-ea5d-4450-9e20-623c2d55a2e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.226449 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-518b0382-ea5d-4450-9e20-623c2d55a2e2 None None] Port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:26.232448 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.263244 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:23Z', 'revision_number': 3, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:26.269527 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ab86833-30fd-47d8-868d-5400da861e16 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:23Z', 'revision_number': 3, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:26.492215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.498185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.536536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:26.635036 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.638976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Pushing event updated for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:26.642959 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:26.785926 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:26.787184 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:26.799404 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44236) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:26.949263 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:26.967348 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:26.971938 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Usage tracker for resource:security_group_rule and tenant:317d54d6d64b41de9ae13f13c26fc3c2 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:26.975821 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:26.982050 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:27.059324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:42:27.094334 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.104056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.111748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-54f4bf80-2f51-4228-802d-033ff39c8c81 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.159114 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=317d54d6d64b41de9ae13f13c26fc3c2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3578391 May 25 15:42:27.160733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44246) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:27.163826 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-eabf7716-f05c-48a0-93ff-7e06d6fd09ba None None] Provisioning complete for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:27.164370 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eabf7716-f05c-48a0-93ff-7e06d6fd09ba None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.189426 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ede5641a-1527-49b4-bdf0-b5d50a66f40f,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:27.195997 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.250231 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-eabf7716-f05c-48a0-93ff-7e06d6fd09ba None None] Port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:27.315104 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:27.346272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.349402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:27.383080 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] 10.222.0.36 "PUT /v2.0/routers/96a94b7a-1c97-4304-a42c-09cef968898f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.2006152 May 25 15:42:27.427702 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.440682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:27.450724 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:27.451109 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.509512 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.513523 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-089bacf5-cc58-460b-9562-b1ae1055f44c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.546976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ede5641a-1527-49b4-bdf0-b5d50a66f40f,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:27.554562 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.562617 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.584598 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/ede5641a-1527-49b4-bdf0-b5d50a66f40f HTTP/1.1" status: 204 len: 168 time: 0.4185448 May 25 15:42:27.685074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.719974 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:27.729199 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:27.731758 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-a908dd6b-75ee-4b24-b6e8-b140859cf1e9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:27.844273 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 req-7f1c75d9-0785-421e-9ff1-105542fda4ab tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:27.846146 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 req-7f1c75d9-0785-421e-9ff1-105542fda4ab tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2307940 May 25 15:42:27.889468 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:27.895949 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:27.963113 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b9959fe6-aa27-4e46-aabe-ec967aa4b896 req-799d1980-7cd2-4916-8e23-5db35d176188 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069613 May 25 15:42:28.404372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44306) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:28.411514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-864094690-network', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:28.417957 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:28.428338 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:28.437756 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:28.438434 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:28.465198 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Usage tracker for resource:network and tenant:dd417f7ce220428a8ac4019081a23f62 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:28.474197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:28.487218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:28.503607 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Made reservation on behalf of dd417f7ce220428a8ac4019081a23f62 for: {'network': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:28.506614 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.523712 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.546083 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:28.550198 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Usage tracker for resource:security_group_rule and tenant:dd417f7ce220428a8ac4019081a23f62 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:28.554539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:28.563541 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:28.626439 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 req-f72e5ee0-42f1-4f81-b891-85a73d1ad48c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.628579 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 req-f72e5ee0-42f1-4f81-b891-85a73d1ad48c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2134192 May 25 15:42:28.654659 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:28.695426 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ac9b3930-e3e4-4e47-aa59-cb2f4a676b79 req-8f4858fb-43d5-46de-b8df-5ce26e050981 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576804 May 25 15:42:28.762762 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.768753 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.772055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1ea7bc8c-fdbc-4315-8fed-f6b81dd9cf43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.804258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 394} {{(pid=98462) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:28.824407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4a8d28a-eb64-4931-8b2b-06f58e78a7c8,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:28.830372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:28.833754 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.834177 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.segments_db [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Added segment c0847609-0609-4583-9f09-a85fe37bef18 of type vlan for network 2c5e4839-a841-4a46-935d-db737f3897d3 May 25 15:42:28.874228 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.908681 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.911051 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:28.912393 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:28.915833 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:28.941041 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44324) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:29.026860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Pushing event updated for resources: {'Network': ['ID=2c5e4839-a841-4a46-935d-db737f3897d3,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:29.031770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:29.033395 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.6273925 May 25 15:42:29.036741 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44332) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:29.043533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Request body: {'subnet': {'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-864094690-subnet', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:29.050336 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:29.054512 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 2c5e4839-a841-4a46-935d-db737f3897d3 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:29.055433 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Usage tracker for resource:subnet and tenant:dd417f7ce220428a8ac4019081a23f62 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:29.059959 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:29.067614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:29.078747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Made reservation on behalf of dd417f7ce220428a8ac4019081a23f62 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:29.081707 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.104406 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2078629524-network', 'tenant_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:29.111671 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:29.170056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Usage tracker for resource:network and tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:29.175288 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:29.183954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:29.210459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Made reservation on behalf of b4d6b8a11a0d4e2c97f55bde6cd2c234 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:29.212858 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.214853 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 2, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:29.219029 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:29.219392 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Updating router 96a94b7a-1c97-4304-a42c-09cef968898f port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:42:29.228885 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.246236 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:29.253037 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Usage tracker for resource:security_group_rule and tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:29.257117 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:29.261071 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:29.265978 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:29.321589 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.400855 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:29.401230 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.590255 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.600703 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.605698 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bc7a9e45-0a6a-451a-8985-5f734396acee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.632874 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 354} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:42:29.651716 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c337b9c8-3c18-4807-9e19-356be0c8c6e9,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:29.655118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:29.657173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.657512 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Added segment 7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402 of type vlan for network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 May 25 15:42:29.698833 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.741937 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.773527 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:29.774118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.782578 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f27000e6-2975-42ca-85d5-a12e0739796a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.795907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.816079 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Transition to ACTIVE for port object f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:29.829088 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.839229 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.952192 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:29.955719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Pushing event updated for resources: {'Network': ['ID=71fe9388-47c1-4797-9687-8ab41ffa2ce9,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:29.964887 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:29.965393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:29.976346 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:42:30.001060 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.0555007 May 25 15:42:30.002958 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44340) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:30.010620 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Request body: {'subnet': {'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2078629524-subnet', 'tenant_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:30.015706 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:30.020516 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Usage tracker for resource:subnet and tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:30.023527 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:30.029829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:30.043571 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Made reservation on behalf of b4d6b8a11a0d4e2c97f55bde6cd2c234 for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:30.046523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10881158'] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.061429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Pushing event updated for resources: {'Subnet': ['ID=106540a5-17af-46aa-898b-cb892e5429a3,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:30.067450 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.078903 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Checking segment: {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:30.079255 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Network hostable DHCP agents. Network: 2c5e4839-a841-4a46-935d-db737f3897d3, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:30.089640 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a52b5ca-6555-4c32-987a-588fab2a2862 req-a7068213-c111-4ab5-bc5d-eef7c02e395e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:30.091108 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7a52b5ca-6555-4c32-987a-588fab2a2862 req-a7068213-c111-4ab5-bc5d-eef7c02e395e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2306833 May 25 15:42:30.138775 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Network 2c5e4839-a841-4a46-935d-db737f3897d3 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:30.150531 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7a52b5ca-6555-4c32-987a-588fab2a2862 req-c9a534bf-27e5-40d7-8936-6154952eb354 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529571 May 25 15:42:30.155490 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Pushing event updated for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:30.159141 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.320s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.160955 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 2c5e4839-a841-4a46-935d-db737f3897d3) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:30.187710 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:30.188329 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.194760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15f18b38-cffa-4fac-a129-eb5442487455 None None] Network 2c5e4839-a841-4a46-935d-db737f3897d3 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:30.209702 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.1708219 May 25 15:42:30.212114 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44346) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:30.217509 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:30.223292 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:30.227358 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Usage tracker for resource:router and tenant:dd417f7ce220428a8ac4019081a23f62 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:30.230914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:30.237016 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:30.248870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.251003 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.258862 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13ad6ee4-ea3c-4b23-8266-8a9272e49b46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.267300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.346841 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Attempting to bind port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:30.347219 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Attempting to bind port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:30.347626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Attempting to bind port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:30.359380 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:30.359823 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:30.360351 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.360755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Bound using segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:30.361227 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Bound port: f20d30cd-8fa6-4272-bdec-eea7e76d7cf3, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:30.361609 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.502412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1633497', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10881168'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.507774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:30.528586 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] For port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:30.533473 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] For port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:30.567394 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.567655 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.577173 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:30.581759 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Pushing event updated for resources: {'Subnet': ['ID=be107ecb-f575-4897-918d-5ad5567180d0,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:30.585272 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:30.591409 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Checking segment: {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:30.591767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Network hostable DHCP agents. Network: 71fe9388-47c1-4797-9687-8ab41ffa2ce9, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:42:30.610191 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:42:30.623652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 71fe9388-47c1-4797-9687-8ab41ffa2ce9) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:30.631283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-2c5e4839-a841-4a46-935d-db737f3897d3', 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'fixed_ips': [{'subnet_id': '106540a5-17af-46aa-898b-cb892e5429a3'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:42:30.632121 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.635635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:30.636302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.647937 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a0966d8c-9538-4760-a075-c879b8e93039 None None] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:30.669939 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6559362 May 25 15:42:30.756763 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:30.757405 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:30.920756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:30.956023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.103623 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Allocated IP 172.27.0.67 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/9705bc2e-e543-4e21-885a-cbfd97ffff91) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:31.129772 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Pushing event updated for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:31.155418 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.578s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.209153 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1134457-2671-4737-806e-f0751e32b9fd None None] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:31.325358 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.357002 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:31.362395 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:31.369219 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:31.408738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57456f67-1119-4808-b644-ef0e15797427 req-c8f36a99-ec9b-49fc-ac51-2c594334f6c7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:31.412271 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-57456f67-1119-4808-b644-ef0e15797427 req-c8f36a99-ec9b-49fc-ac51-2c594334f6c7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.1068723 May 25 15:42:31.514273 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-57456f67-1119-4808-b644-ef0e15797427 req-bba653d5-bf9d-4516-aede-ea4bba63f472 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0943816 May 25 15:42:31.547380 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:31.550194 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:31.554106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:31.584383 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Pushing event updated for resources: {'Port': ['ID=9705bc2e-e543-4e21-885a-cbfd97ffff91,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:31.593885 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:31.709336 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Allocated IP 172.20.0.2 (2c5e4839-a841-4a46-935d-db737f3897d3/106540a5-17af-46aa-898b-cb892e5429a3/87367c2c-8deb-4499-a4e7-a512bc3f3daf) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:31.982977 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.069314 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:30Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:32.079455 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b3a7583-8e8a-4898-901b-3a2e0e802e90 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:30Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:32.086668 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.097108 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Transition to ACTIVE for port object 87367c2c-8deb-4499-a4e7-a512bc3f3daf will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:32.117003 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Transition to ACTIVE for port object 87367c2c-8deb-4499-a4e7-a512bc3f3daf will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:32.125814 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.133906 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:32.226408 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Network 2c5e4839-a841-4a46-935d-db737f3897d3 is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:32.229433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:32.231822 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:32.279733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Pushing event updated for resources: {'Port': ['ID=87367c2c-8deb-4499-a4e7-a512bc3f3daf,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:32.288827 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.347099 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Attempting to bind port 87367c2c-8deb-4499-a4e7-a512bc3f3daf on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:32.347678 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Attempting to bind port 87367c2c-8deb-4499-a4e7-a512bc3f3daf by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:32.348864 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Attempting to bind port 87367c2c-8deb-4499-a4e7-a512bc3f3daf on network 2c5e4839-a841-4a46-935d-db737f3897d3 {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:32.356088 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:32.356468 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Checking segment: {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:32.357399 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.357842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Bound using segment: {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:32.358330 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Bound port: 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:32.358708 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.388170 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.464252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] For port 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:32.468310 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] For port 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=87367c2c-8deb-4499-a4e7-a512bc3f3daf,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:32.473953 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.478626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-bd87caa8-3de0-4bc1-8000-0079676c227e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:32.570727 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Pushing event updated for resources: {'Port': ['ID=87367c2c-8deb-4499-a4e7-a512bc3f3daf,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:32.575299 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:32.626973 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.633626 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Router e827d150-1d40-48ae-a517-391faf4f7fb9 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:42:32.672024 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1d6e7682-efd0-430d-9a12-cfb7ac801e8b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:32.937467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f req-b2b05c6e-3cea-4852-b212-31ee0089f647 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:32.939981 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f req-b2b05c6e-3cea-4852-b212-31ee0089f647 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2064672 May 25 15:42:33.041497 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-a3e979a5-450a-4927-9182-1ff01d1df819 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:33.043854 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-a3e979a5-450a-4927-9182-1ff01d1df819 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 809 time: 0.2028298 May 25 15:42:33.059576 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-7c6c3961-ff64-43aa-9af9-183ef0a9291b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/quotas/b4d6b8a11a0d4e2c97f55bde6cd2c234 HTTP/1.1" status: 200 len: 375 time: 0.0100226 May 25 15:42:33.114063 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-655c4a66-2120-4b69-a56a-866011cec9b2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0480864 May 25 15:42:33.125434 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-711bdd4c-1e7a-4d58-b449-2cd5a1e0236f req-5d8149e0-66c3-49e0-ab63-de260bf00382 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601883 May 25 15:42:33.126330 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:33.134819 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Sync routers for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:33.147614 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:33.149358 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:33.177759 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.179299 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.9661112 May 25 15:42:33.181917 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44388) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:33.415847 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-c0b432e7-139b-4024-b680-1dfc8da55f0f service neutron] 10.222.0.36 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2944989 May 25 15:42:33.445242 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 87367c2c-8deb-4499-a4e7-a512bc3f3daf up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:33.486714 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:33.697401 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.701593 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 87367c2c-8deb-4499-a4e7-a512bc3f3daf completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:33.705612 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:42:33.713013 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:33.779666 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-58af5945-2e8d-49cc-b22d-63f9fae838aa service neutron] 10.222.0.36 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3504148 May 25 15:42:33.810135 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:33.831761 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:33.832789 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:33.914829 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9fd9e84e-1db9-4fbe-a892-61b8643515b0 None None] Network 2c5e4839-a841-4a46-935d-db737f3897d3 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:42:33.975259 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:31Z', 'revision_number': 3, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:33.979224 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Checking router: e827d150-1d40-48ae-a517-391faf4f7fb9 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:33.979578 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Updating router e827d150-1d40-48ae-a517-391faf4f7fb9 port 9705bc2e-e543-4e21-885a-cbfd97ffff91 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:42:34.035940 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.092241 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Provisioning for port 87367c2c-8deb-4499-a4e7-a512bc3f3daf completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:34.104954 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d7d3c0b5-f760-426d-8209-f4797a56e878 req-b144981b-9aec-4ea1-b198-5e384363e964 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 210 time: 0.0665679 May 25 15:42:34.106643 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Provisioning complete for port 87367c2c-8deb-4499-a4e7-a512bc3f3daf triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:34.107585 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.181516 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.245424 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.370277 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:34.382216 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.386119 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.497037 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91b434c-22a1-4a33-a8a9-e34624ca396e req-6fcddc7b-3a75-4800-9e3b-0f1c414e618a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:34.506143 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a91b434c-22a1-4a33-a8a9-e34624ca396e req-6fcddc7b-3a75-4800-9e3b-0f1c414e618a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2041285 May 25 15:42:34.529957 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.532534 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.554164 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Transition to ACTIVE for port object 9705bc2e-e543-4e21-885a-cbfd97ffff91 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:34.557491 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a91b434c-22a1-4a33-a8a9-e34624ca396e req-72b3d31c-c1d7-44d7-bdfe-6c50802d2357 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504842 May 25 15:42:34.564187 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:34.566468 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.569605 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:34.571448 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-5f800ebf-214c-4a5e-9a4b-614bb1db4ec0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.586827 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] For port 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=87367c2c-8deb-4499-a4e7-a512bc3f3daf,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:34.599321 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.602480 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.638736 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Allocated IP 172.20.0.1 (2c5e4839-a841-4a46-935d-db737f3897d3/106540a5-17af-46aa-898b-cb892e5429a3/10ebe78a-0a5b-491d-9a8f-7eba3de16144) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:34.696828 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Pushing event updated for resources: {'Port': ['ID=87367c2c-8deb-4499-a4e7-a512bc3f3daf,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:34.705432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:34.764415 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Attempting to bind port 9705bc2e-e543-4e21-885a-cbfd97ffff91 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:34.764778 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Attempting to bind port 9705bc2e-e543-4e21-885a-cbfd97ffff91 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:34.765140 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Attempting to bind port 9705bc2e-e543-4e21-885a-cbfd97ffff91 on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:34.768738 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7be81c3-d42b-4e91-b48e-a876bc2292de None None] Pushing event updated for resources: {'Port': ['ID=9705bc2e-e543-4e21-885a-cbfd97ffff91,revision_number=2']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:34.773346 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-a7be81c3-d42b-4e91-b48e-a876bc2292de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:34.774254 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:34.774707 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:34.775118 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.775508 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:34.776017 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Bound port: 9705bc2e-e543-4e21-885a-cbfd97ffff91, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:34.776392 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.872697 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.873759 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] For port 9705bc2e-e543-4e21-885a-cbfd97ffff91, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:34.877109 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] For port 9705bc2e-e543-4e21-885a-cbfd97ffff91, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=9705bc2e-e543-4e21-885a-cbfd97ffff91,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:34.881862 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.886867 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.890177 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Transition to ACTIVE for port object 10ebe78a-0a5b-491d-9a8f-7eba3de16144 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:34.913497 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.918091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4be3cd7b-1304-467b-9232-18c54de02c06 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:34.946384 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-0454991d-3185-4047-8fc2-e6d014c2141c None None] Provisioning complete for port 87367c2c-8deb-4499-a4e7-a512bc3f3daf triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:34.946948 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0454991d-3185-4047-8fc2-e6d014c2141c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:34.959751 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:34.960487 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:34.994416 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Network 2c5e4839-a841-4a46-935d-db737f3897d3 is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:34.997509 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:35.001174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:35.032363 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Pushing event updated for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:35.038379 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.065579 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7be81c3-d42b-4e91-b48e-a876bc2292de None None] Pushing event updated for resources: {'Port': ['ID=9705bc2e-e543-4e21-885a-cbfd97ffff91,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:35.068292 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.074145 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-a7be81c3-d42b-4e91-b48e-a876bc2292de None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:35.165150 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.234590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.252427 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:35.274486 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 87367c2c-8deb-4499-a4e7-a512bc3f3daf up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:35.350292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-98600ef1-c0cf-4e1d-9571-b747aa5ee3ff None None] Provisioning for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:35.360452 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-98600ef1-c0cf-4e1d-9571-b747aa5ee3ff None None] Provisioning complete for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:35.360833 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-98600ef1-c0cf-4e1d-9571-b747aa5ee3ff None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.366462 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1fe55d70-2af5-4e32-a2d8-a31ef7f4b1d6 req-e8be7c39-22b3-4540-a330-74251d9f9e6f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 210 time: 0.0798528 May 25 15:42:35.434758 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-98600ef1-c0cf-4e1d-9571-b747aa5ee3ff None None] Port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:35.437140 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 87367c2c-8deb-4499-a4e7-a512bc3f3daf triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:35.437549 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.602999 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:31Z', 'revision_number': 3, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:35.608809 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-07d989ac-d955-4fc5-af47-31593d440017 None None] The sync data for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi is: [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:31Z', 'revision_number': 3, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:35.671453 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:35.797403 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:35.797787 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.810514 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.824436 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:35.856639 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:35.961774 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Pushing event updated for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:35.978526 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:36.027049 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:36.031208 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 req-a7801c50-2bc2-457c-a46f-409ccb723407 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:36.036342 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 req-a7801c50-2bc2-457c-a46f-409ccb723407 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2177577 May 25 15:42:36.123377 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f8c95fb9-c354-4c12-b294-3a2c61a5ca23 req-3a9b37f7-c6fd-4789-9839-59abaf646fa9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0745301 May 25 15:42:36.131974 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-961a5c80-0c33-4ce4-9ece-9098c92cdf49 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:36.133750 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-961a5c80-0c33-4ce4-9ece-9098c92cdf49 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 809 time: 0.4410262 May 25 15:42:36.167354 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Request body: {'port': {'device_id': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9', 'admin_state_up': True, 'tenant_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:36.217402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Network 2c5e4839-a841-4a46-935d-db737f3897d3 is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:36.218987 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:36.440531 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:36.449648 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Usage tracker for resource:port and tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:36.459247 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:36.477984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:36.517202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Made reservation on behalf of b4d6b8a11a0d4e2c97f55bde6cd2c234 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:42:36.521906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:36.559418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15eb9155-1ca1-4465-85dd-c70806371816 req-874264fb-bd08-4a11-9e65-b4b514ae769f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:36.561301 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-15eb9155-1ca1-4465-85dd-c70806371816 req-874264fb-bd08-4a11-9e65-b4b514ae769f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.2086592 May 25 15:42:36.576934 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-44f4c3e1-1731-4e2d-b3a8-515bdf8d75b5 None None] Provisioning complete for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:36.577308 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-44f4c3e1-1731-4e2d-b3a8-515bdf8d75b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:36.578611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Router e827d150-1d40-48ae-a517-391faf4f7fb9 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:42:36.593868 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4609961a-ebed-4de9-a7b8-e9d58c559851 req-5d7737eb-5820-40c7-9c75-1004e800f29e tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 210 time: 0.0652328 May 25 15:42:36.677957 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-44f4c3e1-1731-4e2d-b3a8-515bdf8d75b5 None None] Port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:42:36.696133 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-15eb9155-1ca1-4465-85dd-c70806371816 req-71196cdd-bd5b-43f6-9d2f-55363512c8a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0876527 May 25 15:42:36.787611 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Allocated IP 172.20.0.11 (71fe9388-47c1-4797-9687-8ab41ffa2ce9/be107ecb-f575-4897-918d-5ad5567180d0/36833437-89ff-4bb3-978e-a332e89af2e5) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:42:36.826281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:42:36.839911 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-299174a5-4612-48e1-8aac-56c959a52dfc admin admin] 10.222.0.36 "PUT /v2.0/routers/e827d150-1d40-48ae-a517-391faf4f7fb9/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.6569052 May 25 15:42:37.019636 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.053978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.061907 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b280aa8f-09ad-4a7e-8325-7cf8bcb161eb service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.132774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:42:37.136090 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:42:37.140846 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:42:37.178043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Pushing event updated for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:37.182996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.213819 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.214716 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.240226 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0768311 May 25 15:42:37.268854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Request body: {'port': {'device_id': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:37.307036 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 9705bc2e-e543-4e21-885a-cbfd97ffff91 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:37.387354 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 9705bc2e-e543-4e21-885a-cbfd97ffff91 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:37.392845 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 9705bc2e-e543-4e21-885a-cbfd97ffff91 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:37.393226 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.465995 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.491996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-102c1fc9-148d-462f-9156-ac4c9b42f76a req-7bf1543b-f490-450a-8d4f-eb8e34c0f1a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.496374 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-102c1fc9-148d-462f-9156-ac4c9b42f76a req-7bf1543b-f490-450a-8d4f-eb8e34c0f1a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.1930654 May 25 15:42:37.520207 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.536760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 9705bc2e-e543-4e21-885a-cbfd97ffff91, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=9705bc2e-e543-4e21-885a-cbfd97ffff91,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:37.541650 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.543798 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:37.600163 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-102c1fc9-148d-462f-9156-ac4c9b42f76a req-1f7d05e2-7317-4ec6-a724-2a251eb84bf0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779097 May 25 15:42:37.654979 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=9705bc2e-e543-4e21-885a-cbfd97ffff91,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:37.661167 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:37.890668 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Sync routers for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:42:37.902679 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:37.902679 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:37.948771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44446) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:37.954335 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1147553235', 'description': 'tempest-secgroup-smoke-1147553235 description', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:37.962469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:37.966260 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:37.969502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:37.977030 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:37.990172 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:37.998397 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 req-abb9b4f5-0d65-4e4e-a258-6df1af4d71e8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:37.999106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 req-abb9b4f5-0d65-4e4e-a258-6df1af4d71e8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Synchronizing usage tracker for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:38.014999 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:38.021002 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:38.023952 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:38.029810 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:38.081613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36833437-89ff-4bb3-978e-a332e89af2e5 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:38.089777 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.105920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Transition to ACTIVE for port object 36833437-89ff-4bb3-978e-a332e89af2e5 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:38.110733 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.112097 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:38.116052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.175473 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ff0279-c52d-4221-a8c3-2152dbecd862 req-1d2b1842-46bc-439d-8382-08cf9f2cb483 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.178008 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d1ff0279-c52d-4221-a8c3-2152dbecd862 req-1d2b1842-46bc-439d-8382-08cf9f2cb483 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1195309 May 25 15:42:38.206196 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.233481 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d1ff0279-c52d-4221-a8c3-2152dbecd862 req-78f0736e-36a8-419b-a9a3-6bbf5f7fd220 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461864 May 25 15:42:38.234051 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.251967 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Pushing event updated for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.255316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.255934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 req-abb9b4f5-0d65-4e4e-a258-6df1af4d71e8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Unset dirty status for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:38.257081 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 req-abb9b4f5-0d65-4e4e-a258-6df1af4d71e8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 932 time: 0.5021515 May 25 15:42:38.264644 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3dbad68c-d3a1-4613-84c1-2b8460de8fe2 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.277543 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.281856 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.3304560 May 25 15:42:38.283365 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44450) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:38.291558 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:38.306456 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:38.314141 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:38.317974 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:38.320737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.325468 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.326325 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:38.345697 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.390394 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff7116a6-6cca-4cf4-a5fd-971a3a2ea818 req-eadddb17-dad7-4a33-8d39-0d573acd5a0b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1069665 May 25 15:42:38.418727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.420567 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Attempting to bind port 36833437-89ff-4bb3-978e-a332e89af2e5 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:38.422789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Attempting to bind port 36833437-89ff-4bb3-978e-a332e89af2e5 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:38.423335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Attempting to bind port 36833437-89ff-4bb3-978e-a332e89af2e5 on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:38.425142 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.428697 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.429892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Port 36833437-89ff-4bb3-978e-a332e89af2e5 on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:42:38.430221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Attempting to bind port 36833437-89ff-4bb3-978e-a332e89af2e5 on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:38.436375 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:38.436713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Checking segment: {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:38.437093 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Bound using segment: {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:38.437521 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Bound port: 36833437-89ff-4bb3-978e-a332e89af2e5, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:38.438027 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.453316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ddee4c1e-adb0-4802-a5bb-3eef07877d29,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.456630 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.465431 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.469167 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1823354 May 25 15:42:38.469614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44454) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:38.475618 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:38.478235 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:35Z', 'revision_number': 4, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '10ebe78a-0a5b-491d-9a8f-7eba3de16144', 'name': '', 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'mac_address': 'fa:16:3e:4a:b2:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_interface', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': '106540a5-17af-46aa-898b-cb892e5429a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:34Z', 'updated_at': '2021-05-25T15:42:35Z', 'revision_number': 2, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'subnets': [{'id': '106540a5-17af-46aa-898b-cb892e5429a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:38.481148 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:38.482284 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Checking router: e827d150-1d40-48ae-a517-391faf4f7fb9 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:42:38.482644 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Updating router e827d150-1d40-48ae-a517-391faf4f7fb9 port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:42:38.484949 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:38.487798 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:38.493682 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:38.511007 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.537989 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:38.541154 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.541302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=36833437-89ff-4bb3-978e-a332e89af2e5,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:38.545550 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.550268 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.577138 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.582426 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.590853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.613083 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.613742 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.614060 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ca5a7fbd-35ac-43d8-8ffe-03b2d3ff49bb,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.615147 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] 10.222.0.70 "PUT /v2.0/ports/36833437-89ff-4bb3-978e-a332e89af2e5 HTTP/1.1" status: 200 len: 1094 time: 1.3513014 May 25 15:42:38.615672 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:38.621614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.627541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.630221 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1b1d227f-53ec-4ccc-afd0-730e32323409 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1582818 May 25 15:42:38.632273 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44460) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:38.638993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:38.646672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:38.651827 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:38.652701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Pushing event updated for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.655530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:38.656942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.666536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:38.687332 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.733685 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5', 'status': 'completed', 'code': 200} May 25 15:42:38.764537 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.770682 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.773472 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.777298 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-21200af1-03ca-4eff-b2d9-e5b827eb4209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.778807 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-21200af1-03ca-4eff-b2d9-e5b827eb4209 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 1097 time: 0.0861230 May 25 15:42:38.797588 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=51f88fdf-8942-470b-9e0f-9bf70a0bc1f3,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.800413 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.814141 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.820251 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6907fdd0-0447-4bf0-815d-3295c708450d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1870761 May 25 15:42:38.821175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44466) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:38.828433 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:38.835282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:38.839415 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:38.842816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:38.849326 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:38.869097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.897001 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-5ab98ddf-df11-4eb5-bf89-de6f30d977de service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=36833437-89ff-4bb3-978e-a332e89af2e5 HTTP/1.1" status: 200 len: 217 time: 0.0781779 May 25 15:42:38.926608 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.938766 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.940682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Transition to ACTIVE for port object 10ebe78a-0a5b-491d-9a8f-7eba3de16144 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:42:38.944287 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.946830 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-298f52ce-f1a7-4818-b7ed-5ed4e070c53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.950774 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.962015 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:38.978474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=227e6ce3-b370-4839-a167-447a79b3cb4a,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:38.981493 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:38.986422 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:38.989570 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c920619c-2b20-4e7a-b215-be04f159866e req-e0aee5bb-d17b-4738-913f-1c6604895585 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.991064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c920619c-2b20-4e7a-b215-be04f159866e req-e0aee5bb-d17b-4738-913f-1c6604895585 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2113001 May 25 15:42:38.991682 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9a0ac46c-a14a-4d8c-9426-30635a295f32 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1691308 May 25 15:42:38.992486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44472) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:38.994784 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-87621aa5-7124-48e0-b556-1d49341b37ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:38.996168 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-87621aa5-7124-48e0-b556-1d49341b37ad service neutron] 10.222.0.70 "GET /v2.0/subnets?id=be107ecb-f575-4897-918d-5ad5567180d0 HTTP/1.1" status: 200 len: 849 time: 0.0850947 May 25 15:42:38.998369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:39.006306 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:39.012316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:39.017439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:39.032284 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:39.064416 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.securitygroups_db [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Project 8dff1003ceba47f6a75b4c3901343b7b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:42:39.068410 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-88016df8-a86b-4dd5-9654-f232df549668 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=71fe9388-47c1-4797-9687-8ab41ffa2ce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0556750 May 25 15:42:39.071281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.089652 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c920619c-2b20-4e7a-b215-be04f159866e req-ba10f538-6557-4121-820c-2d30f5b60b56 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0911818 May 25 15:42:39.190661 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.201058 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.203160 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-65ad647b-2963-4a54-9ac8-0bd5d98104cd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.205074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Pushing event updated for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:39.220651 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.259s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.233959 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Attempting to bind port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:42:39.234091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a1e13d53-e77d-4af6-8fb6-4aa79036b065,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:39.234203 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Attempting to bind port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:42:39.234478 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Attempting to bind port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 on network 2c5e4839-a841-4a46-935d-db737f3897d3 {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:42:39.239447 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.249810 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.250377 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0e1bc674-a64e-4d0c-92cb-65dabc514d29 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2564416 May 25 15:42:39.253052 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 44476) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:42:39.257780 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:42:39.258164 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Checking segment: {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:42:39.258570 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.258865 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'security_group_rule': {'security_group_id': '1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb', 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:42:39.258998 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Bound using segment: {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:42:39.263111 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Bound port: 10ebe78a-0a5b-491d-9a8f-7eba3de16144, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c0847609-0609-4583-9f09-a85fe37bef18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:42:39.263527 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.265794 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:42:39.269900 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:security_group_rule and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:42:39.272985 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:42:39.276030 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-36e9c10b-0a43-4060-b0b1-b94ffc6eb242 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1876745 May 25 15:42:39.282198 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 9705bc2e-e543-4e21-885a-cbfd97ffff91 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:39.282790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:42:39.297097 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.securitygroups_db [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Project 8dff1003ceba47f6a75b4c3901343b7b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:42:39.304159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.380201 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.386149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.389203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.416506 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e138bb4-983a-44bd-89f8-2ae9e95c51f8,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:39.442536 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] For port 10ebe78a-0a5b-491d-9a8f-7eba3de16144, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:42:39.445873 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] For port 10ebe78a-0a5b-491d-9a8f-7eba3de16144, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=10ebe78a-0a5b-491d-9a8f-7eba3de16144,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:42:39.452627 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 9705bc2e-e543-4e21-885a-cbfd97ffff91 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:39.453006 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.457800 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.461704 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c9d339b4-358c-4d02-8c20-ead0972fe6e5 req-25d9a598-e5d1-489a-8c46-b956b03272e3 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1650534 May 25 15:42:39.484167 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.485567 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-857f9b4c-713d-474c-ae91-30448abbe67d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2315218 May 25 15:42:39.499086 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:39.515162 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:39.534363 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-187b3533-e6cd-42b1-8224-42b5aa4366cf req-2c45ba6a-cde7-4286-9b26-3934da6cd702 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:39.543333 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-187b3533-e6cd-42b1-8224-42b5aa4366cf req-2c45ba6a-cde7-4286-9b26-3934da6cd702 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1362398 May 25 15:42:39.610478 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-187b3533-e6cd-42b1-8224-42b5aa4366cf req-c8b98596-24ab-4f8d-8548-7134f59b84ad tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0622952 May 25 15:42:39.620390 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:42:39.621033 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:42:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:39.724011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-2d917cdd-d115-4a8e-af04-4b0dab9e2d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:39.725706 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-2d917cdd-d115-4a8e-af04-4b0dab9e2d1a service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 1097 time: 0.1961141 May 25 15:42:39.737138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ae36b9e-24db-4d45-be52-9829972010ab req-8517f56a-5790-40f7-b0ab-145dd1ac74d7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:39.739571 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4ae36b9e-24db-4d45-be52-9829972010ab req-8517f56a-5790-40f7-b0ab-145dd1ac74d7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 944 time: 0.1415079 May 25 15:42:39.849369 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:42:39.893093 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4ae36b9e-24db-4d45-be52-9829972010ab req-3c2f0630-6119-4d97-8507-46211798a266 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1327927 May 25 15:42:39.918840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Pushing event updated for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:39.926190 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-875d68e9-1676-4336-a3cd-f69703b35eae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:39.927843 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.413s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:39.928375 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-875d68e9-1676-4336-a3cd-f69703b35eae service neutron] 10.222.0.70 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 910 time: 0.1875710 May 25 15:42:40.129189 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-e0756387-bf40-4916-82af-3bb3ba620d36 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=36833437-89ff-4bb3-978e-a332e89af2e5 HTTP/1.1" status: 200 len: 217 time: 0.1717179 May 25 15:42:40.214168 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-3d487905-bd7f-4f1c-815e-2a3097d27a1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.215847 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-3d487905-bd7f-4f1c-815e-2a3097d27a1c service neutron] 10.222.0.70 "GET /v2.0/subnets?id=be107ecb-f575-4897-918d-5ad5567180d0 HTTP/1.1" status: 200 len: 849 time: 0.0756116 May 25 15:42:40.297456 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:35Z', 'revision_number': 4, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '10ebe78a-0a5b-491d-9a8f-7eba3de16144', 'name': '', 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'mac_address': 'fa:16:3e:4a:b2:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_interface', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': '106540a5-17af-46aa-898b-cb892e5429a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:34Z', 'updated_at': '2021-05-25T15:42:39Z', 'revision_number': 4, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'subnets': [{'id': '106540a5-17af-46aa-898b-cb892e5429a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:42:40.304665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1a42f17-b8b5-4d05-bbe1-466f067b413e None None] The sync data for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi is: [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:35Z', 'revision_number': 4, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '10ebe78a-0a5b-491d-9a8f-7eba3de16144', 'name': '', 'network_id': '2c5e4839-a841-4a46-935d-db737f3897d3', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'mac_address': 'fa:16:3e:4a:b2:a8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_interface', 'standard_attr_id': 417, 'fixed_ips': [{'subnet_id': '106540a5-17af-46aa-898b-cb892e5429a3', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:34Z', 'updated_at': '2021-05-25T15:42:39Z', 'revision_number': 4, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'subnets': [{'id': '106540a5-17af-46aa-898b-cb892e5429a3', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:42:40.315947 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-9c987f4f-923f-4d7f-9d98-0807f90a0e32 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=71fe9388-47c1-4797-9687-8ab41ffa2ce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0810759 May 25 15:42:40.467834 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 req-a3e96ddf-0087-408e-bda6-b021821f6b80 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.469502 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 req-a3e96ddf-0087-408e-bda6-b021821f6b80 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2090731 May 25 15:42:40.497426 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-d26b0cb5-11e8-4b31-ac9c-86acb13fa065 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1735704 May 25 15:42:40.524533 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-de68616d-1c0d-4cdd-b2d9-3f26ec60f059 req-049e123e-571f-49ca-9a67-163f9606a6ae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467217 May 25 15:42:40.624801 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:40.646124 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d5b85d3b-ba46-47f3-9e21-3340290de458 req-afd32021-3034-4120-b8d4-1c3c562b9e6a service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1396973 May 25 15:42:40.799557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-332a7149-098e-4d9e-bc72-268c8ffdadcc req-15848ba2-3a31-4177-991d-c6f610953371 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:40.801889 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-332a7149-098e-4d9e-bc72-268c8ffdadcc req-15848ba2-3a31-4177-991d-c6f610953371 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0848498 May 25 15:42:40.860281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-332a7149-098e-4d9e-bc72-268c8ffdadcc req-72bd494d-4591-4c57-96fc-9fe6006150bb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457346 May 25 15:42:41.092573 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 req-557068e5-4b1a-462a-bf36-418cd64facae tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:41.094090 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 req-557068e5-4b1a-462a-bf36-418cd64facae tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 944 time: 0.0922418 May 25 15:42:41.139887 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 req-7dce26d6-1fa6-44db-8f7d-3f438383726f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Synchronizing usage tracker for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:41.157730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 req-7dce26d6-1fa6-44db-8f7d-3f438383726f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Unset dirty status for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:41.158891 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3b02bb6d-50b9-49dc-87db-dd8f705d6554 req-7dce26d6-1fa6-44db-8f7d-3f438383726f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589817 May 25 15:42:41.262102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 10ebe78a-0a5b-491d-9a8f-7eba3de16144 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:41.333902 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:41.339019 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:41.339602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:41.459719 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:41.490827 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 10ebe78a-0a5b-491d-9a8f-7eba3de16144, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=10ebe78a-0a5b-491d-9a8f-7eba3de16144,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:41.494760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:41.496680 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-aad841e1-3d3e-4f11-a2fd-2552347a7e05 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:41.562900 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:41.565931 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:41.724441 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f req-814fa71f-6955-47d9-bc33-adaca6c0434b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:41.725904 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f req-814fa71f-6955-47d9-bc33-adaca6c0434b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0829389 May 25 15:42:41.770038 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e17c98ca-ffd0-4e7d-9832-2f8d14368a0f req-c76fc34e-2bdc-4b03-af62-74c397017b67 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380349 May 25 15:42:42.047589 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 req-0f8f22df-a7c5-4c7f-977e-9775b079c990 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.049069 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 req-0f8f22df-a7c5-4c7f-977e-9775b079c990 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0783098 May 25 15:42:42.094767 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9fa16ce8-361c-4dee-baa9-d829bdb25b91 req-9294a620-41bc-428a-9587-c7d1ab5a785d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394683 May 25 15:42:42.287239 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 36833437-89ff-4bb3-978e-a332e89af2e5 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:42.350018 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d req-857e95b6-cdd1-41bc-a10a-0522aaa2c828 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.351649 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d req-857e95b6-cdd1-41bc-a10a-0522aaa2c828 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 944 time: 0.0826423 May 25 15:42:42.413652 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-01b0a1a9-6e8a-4c30-b7e1-5219e33b266d req-870ce5bd-4d2b-4851-9e05-6bef4e2ef6a2 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559733 May 25 15:42:42.445718 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=36833437-89ff-4bb3-978e-a332e89af2e5,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:42.458785 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '36833437-89ff-4bb3-978e-a332e89af2e5', 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9', 'port_id': '36833437-89ff-4bb3-978e-a332e89af2e5', 'mac_address': 'fa:16:3e:78:df:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be107ecb-f575-4897-918d-5ad5567180d0', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:42.516641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:42.533073 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36833437-89ff-4bb3-978e-a332e89af2e5 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:42.548266 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=36833437-89ff-4bb3-978e-a332e89af2e5,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:42.552807 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:42.554907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-6dab8212-bea5-4687-9919-a1e14d96e8fa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:42.622521 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:42.625432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:42.963166 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 req-54059e02-40f0-4055-a77e-cea8142f404e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:42.964542 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 req-54059e02-40f0-4055-a77e-cea8142f404e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0809064 May 25 15:42:43.018346 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6dbc407e-fc5f-420c-8ffc-7f1ff507ebb4 req-1b5b1269-72a9-4d21-a86f-be7fea640cb1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479727 May 25 15:42:43.213797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['36833437-89ff-4bb3-978e-a332e89af2e5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:43.259053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 10ebe78a-0a5b-491d-9a8f-7eba3de16144 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:43.287559 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 req-551473f9-2048-4837-814c-a99ff0dc226e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:43.289042 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 req-551473f9-2048-4837-814c-a99ff0dc226e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0837080 May 25 15:42:43.337102 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a9119e99-4598-4d8e-bf9a-66a0abae0b64 req-6ddac310-4826-4c83-9549-83c75ab283da tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422347 May 25 15:42:43.381755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:43.382323 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:43.617576 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a req-5562e313-6b0b-4d55-ad93-46869aaf4c88 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:43.619063 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a req-5562e313-6b0b-4d55-ad93-46869aaf4c88 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 945 time: 0.0929308 May 25 15:42:43.666294 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6c6d7b3f-6f0e-4d1b-b30a-0db548bd0e6a req-19d6883a-2438-4af8-a5c1-9d4d6299839b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398035 May 25 15:42:44.016794 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082def58-ca7e-4882-b3dd-eb903773f270 req-2e0fe856-e138-40e9-8b99-52974e64c6aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.018201 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-2e0fe856-e138-40e9-8b99-52974e64c6aa service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.0760658 May 25 15:42:44.052454 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 req-f631d60c-7469-466a-a1b4-6ba7c7090fff tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.056293 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 req-f631d60c-7469-466a-a1b4-6ba7c7090fff tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0881321 May 25 15:42:44.111849 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb9fb575-e82d-422e-96ea-8ce9c6236c47 req-e46aa518-aa7c-4b12-965b-1b37a4daca28 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512769 May 25 15:42:44.211154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082def58-ca7e-4882-b3dd-eb903773f270 req-61a8f376-bed4-4290-a2d0-547a2cd47fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.212678 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-61a8f376-bed4-4290-a2d0-547a2cd47fd3 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.1793370 May 25 15:42:44.292372 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-44c0745b-cbd4-4a10-ab71-dcc2f174cd2a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.0659962 May 25 15:42:44.299869 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97c77325-d813-4d87-a228-20f52b93d5b7 req-256d42c0-cd2f-42d5-bf2d-56adbb8e7cef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.301805 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-97c77325-d813-4d87-a228-20f52b93d5b7 req-256d42c0-cd2f-42d5-bf2d-56adbb8e7cef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.1650872 May 25 15:42:44.399182 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-97c77325-d813-4d87-a228-20f52b93d5b7 req-f5c182b0-18e6-4053-b49d-52a0617545ef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0905235 May 25 15:42:44.400667 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082def58-ca7e-4882-b3dd-eb903773f270 req-a36cf408-1d12-4cf2-9683-76ae87c4996b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.402050 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-a36cf408-1d12-4cf2-9683-76ae87c4996b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.0945539 May 25 15:42:44.460422 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-3b12a71e-f2f5-4c9b-b75d-14324cb67946 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0426853 May 25 15:42:44.528136 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25f19be1-90e9-481c-820c-ffcd44592724 req-6d0dbdac-ad60-4505-8a14-ed0620110cb9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.529582 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-25f19be1-90e9-481c-820c-ffcd44592724 req-6d0dbdac-ad60-4505-8a14-ed0620110cb9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0784583 May 25 15:42:44.576813 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-25f19be1-90e9-481c-820c-ffcd44592724 req-d58c7ad9-4423-478a-b5c7-ffed18ebeafb tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413964 May 25 15:42:44.602246 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-8b7b1960-c3ae-4661-8efa-8fac326249da service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273808 May 25 15:42:44.887281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-082def58-ca7e-4882-b3dd-eb903773f270 req-c21e09fe-140a-4cb9-8c18-d580bcd7671f service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2690077 May 25 15:42:44.904418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-072422d2-56e9-4cf7-9518-d7c5f34324a5 req-87f84fd6-cfd2-4da6-b660-5a9f5a33dbe6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:44.905827 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-072422d2-56e9-4cf7-9518-d7c5f34324a5 req-87f84fd6-cfd2-4da6-b660-5a9f5a33dbe6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 945 time: 0.1239302 May 25 15:42:44.953572 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-072422d2-56e9-4cf7-9518-d7c5f34324a5 req-02852367-7589-42b2-9146-7a17ba57e9fa tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410924 May 25 15:42:45.296091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 req-0f99e140-bbb9-4e0e-a30f-b84620cd938e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.297563 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 req-0f99e140-bbb9-4e0e-a30f-b84620cd938e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0794885 May 25 15:42:45.341417 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-edfa5ab3-d89a-474e-b157-361d1c0cacc0 req-14b3d256-0132-4f8d-9489-3382bf0f6aea tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382233 May 25 15:42:45.593066 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0b2e42-1721-47d3-91a3-b33919da5912 req-f4172943-d60a-46a7-9e90-d5cefb7b0fa9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.594524 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1c0b2e42-1721-47d3-91a3-b33919da5912 req-f4172943-d60a-46a7-9e90-d5cefb7b0fa9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0774293 May 25 15:42:45.640085 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1c0b2e42-1721-47d3-91a3-b33919da5912 req-a0764359-d302-4d41-9741-841492b0858c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392213 May 25 15:42:45.769018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd161ad-98fb-48d1-9b2b-395593db031a req-e3c05ba5-c58f-4edf-907e-42228feac17e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:45.771319 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4dd161ad-98fb-48d1-9b2b-395593db031a req-e3c05ba5-c58f-4edf-907e-42228feac17e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0852594 May 25 15:42:45.815780 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4dd161ad-98fb-48d1-9b2b-395593db031a req-165af47a-d7e5-4bc0-af40-918265d8271b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388956 May 25 15:42:46.146142 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6e003f-3ccc-4341-a94b-e367588c635c req-ee1807cf-595b-42fd-b54d-0a6e8c65b53d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.147607 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b6e003f-3ccc-4341-a94b-e367588c635c req-ee1807cf-595b-42fd-b54d-0a6e8c65b53d tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 945 time: 0.0862472 May 25 15:42:46.191453 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b6e003f-3ccc-4341-a94b-e367588c635c req-325601d4-2191-467e-bcdd-b05d72b8f106 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382841 May 25 15:42:46.300488 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 36833437-89ff-4bb3-978e-a332e89af2e5 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:46.368133 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 36833437-89ff-4bb3-978e-a332e89af2e5 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:42:46.373116 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 36833437-89ff-4bb3-978e-a332e89af2e5 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:46.373491 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.519238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.532316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c req-9f4bfaa9-cc13-4fea-b538-980ac97f1ea1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.533977 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c req-9f4bfaa9-cc13-4fea-b538-980ac97f1ea1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0796187 May 25 15:42:46.553018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:46.562835 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=36833437-89ff-4bb3-978e-a332e89af2e5,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:46.567234 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:46.570528 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:46.582315 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7c7a3c0f-8526-4dd9-8ff6-3adc051e856c req-ed284b3e-5102-4a08-8c40-37da6d0500fd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418217 May 25 15:42:46.610473 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5', 'code': 200} May 25 15:42:46.642506 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:46.645579 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:46.840074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 req-580e97de-b950-47db-9a56-10c993d457c2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.847093 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 req-580e97de-b950-47db-9a56-10c993d457c2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0901322 May 25 15:42:46.898380 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0ec86489-a409-4c9c-95f9-85d57bdbfc58 req-cfd59efa-3fcf-45d8-8280-99324f6d94a3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496128 May 25 15:42:46.908880 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fed91d9-8836-456b-b201-ee68533b0c6d req-29f787c4-1fa3-40a0-b5cd-1a3d2cb2ea8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:46.913607 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4fed91d9-8836-456b-b201-ee68533b0c6d req-29f787c4-1fa3-40a0-b5cd-1a3d2cb2ea8c service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 1099 time: 0.0905833 May 25 15:42:47.016966 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4fed91d9-8836-456b-b201-ee68533b0c6d req-b9ccfe82-2e8d-4158-9810-f14b1f7c534b service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0872722 May 25 15:42:47.042731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5f6793a-3022-4f36-ac50-b4c097bf3abb req-589c7bab-b765-44ef-b047-68db736be2b6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.044169 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c5f6793a-3022-4f36-ac50-b4c097bf3abb req-589c7bab-b765-44ef-b047-68db736be2b6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1019804 May 25 15:42:47.088547 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c5f6793a-3022-4f36-ac50-b4c097bf3abb req-06f92ffd-d44c-4d04-92f0-edd9e5aed724 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385511 May 25 15:42:47.377451 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-602a87d2-1049-4f98-a78d-443d5fcf183c req-ae162c67-b29f-4533-8631-c535f4d119f9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.378934 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-602a87d2-1049-4f98-a78d-443d5fcf183c req-ae162c67-b29f-4533-8631-c535f4d119f9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.0794075 May 25 15:42:47.427513 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-602a87d2-1049-4f98-a78d-443d5fcf183c req-a5a4094b-f53f-4bb6-b867-ac3fc85f5658 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429385 May 25 15:42:47.770862 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f752b289-9db1-4846-9ad5-88c2bfa73bce req-2e48baf8-69ac-441e-9e53-291c869c6a5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:47.772351 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f752b289-9db1-4846-9ad5-88c2bfa73bce req-2e48baf8-69ac-441e-9e53-291c869c6a5a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0780616 May 25 15:42:47.819998 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f752b289-9db1-4846-9ad5-88c2bfa73bce req-251e10f5-c8fe-473d-b9d6-f2b678b4068c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421014 May 25 15:42:48.084594 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4abb8437-f78a-4468-9a29-87bbe7374996 req-cfcde8f1-1cc7-46df-9566-45c8e3a0e22b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:48.085956 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4abb8437-f78a-4468-9a29-87bbe7374996 req-cfcde8f1-1cc7-46df-9566-45c8e3a0e22b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0798297 May 25 15:42:48.130502 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4abb8437-f78a-4468-9a29-87bbe7374996 req-e1fe2374-95a8-4f34-8e55-d2401472c17a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389082 May 25 15:42:48.274085 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ddcc95-0768-423d-ae84-a07a443cc79b req-c99b134d-829a-43ba-8061-2412d0e7559a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:48.275531 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e5ddcc95-0768-423d-ae84-a07a443cc79b req-c99b134d-829a-43ba-8061-2412d0e7559a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0798147 May 25 15:42:48.321275 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e5ddcc95-0768-423d-ae84-a07a443cc79b req-57995f70-cb91-40ef-a280-07abfec7c08d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399799 May 25 15:42:48.619393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf req-645fc443-21bf-40f7-87db-1613c28bd759 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:48.620864 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf req-645fc443-21bf-40f7-87db-1613c28bd759 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.0862939 May 25 15:42:48.667129 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-28b26fa2-6fc6-42af-b4fb-e7e79c8973cf req-f0196ed8-17d0-4249-8dc4-f8e7cfaea297 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403917 May 25 15:42:49.009490 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0153f90f-e568-4f1a-859b-f0625f3df9f9 req-85d45075-baae-4f1d-9968-35c8ad5818ac tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:49.011767 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0153f90f-e568-4f1a-859b-f0625f3df9f9 req-85d45075-baae-4f1d-9968-35c8ad5818ac tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0856829 May 25 15:42:49.055985 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0153f90f-e568-4f1a-859b-f0625f3df9f9 req-edfb02f9-370b-4a17-b724-b5d56bf6cf95 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387471 May 25 15:42:49.317962 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d72f7137-03f8-41c6-a7d9-2b21d2677065 req-d646adf5-19cf-4514-8920-5310347d6872 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:49.319332 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d72f7137-03f8-41c6-a7d9-2b21d2677065 req-d646adf5-19cf-4514-8920-5310347d6872 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0798216 May 25 15:42:49.364093 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d72f7137-03f8-41c6-a7d9-2b21d2677065 req-67827791-b510-4127-a924-3188eba67c78 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389104 May 25 15:42:49.516552 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 req-e4daea30-7599-4f55-b34c-6770e8ff69bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:49.518039 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 req-e4daea30-7599-4f55-b34c-6770e8ff69bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0823581 May 25 15:42:49.566508 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a9f15b3-53d1-4cca-95c0-729c022af6c7 req-1b22f85c-1472-40ba-8e0c-e6214f439ede tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422101 May 25 15:42:49.855399 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 req-9bb5a387-36fa-40c6-b8e7-4b0325ab6cd3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:49.857109 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 req-9bb5a387-36fa-40c6-b8e7-4b0325ab6cd3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.0837433 May 25 15:42:49.901426 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-70785dfa-43ce-43ee-9e5d-9806c7e17e12 req-7c3ae7c7-8e37-4d56-afc6-be13b7a5baa0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386391 May 25 15:42:50.245387 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea1dbe23-9f94-4358-895a-0731eefecddf req-8b13bdf3-8ca1-471f-b1c4-f1358efa0805 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:50.246842 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ea1dbe23-9f94-4358-895a-0731eefecddf req-8b13bdf3-8ca1-471f-b1c4-f1358efa0805 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0828526 May 25 15:42:50.290774 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ea1dbe23-9f94-4358-895a-0731eefecddf req-e1ee8685-fff1-40f9-82be-efe79c8076da tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382349 May 25 15:42:50.316700 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:42:50.461326 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:50.476838 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:42:50.537139 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.557085 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:42:50.560923 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 req-30f12d9f-7233-409c-a34d-f6c1bd4e58f7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:50.563423 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 req-30f12d9f-7233-409c-a34d-f6c1bd4e58f7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0845878 May 25 15:42:50.575336 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:50.578655 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:50.581391 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:50.608546 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a7a7bc23-bd0e-4ff8-81dc-548c91ea6a74 req-19633352-3f53-42fa-9797-c1b0abc5c5f4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386677 May 25 15:42:50.650602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=6']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:50.654158 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:50.761501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02cd9cd5-2917-4173-b050-9674702e5d43 req-c6ceebf4-feb4-41af-900d-412e415fc7b9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:50.762959 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02cd9cd5-2917-4173-b050-9674702e5d43 req-c6ceebf4-feb4-41af-900d-412e415fc7b9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0803421 May 25 15:42:50.805788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['3f734a1c-be04-4203-b351-6b0b6785f9ae'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:50.811154 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02cd9cd5-2917-4173-b050-9674702e5d43 req-232f503c-5c8f-4039-8030-ba9a82646766 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425363 May 25 15:42:51.440793 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0089847d-1030-40ca-b174-fd695429b3c5 req-8f57044a-349c-4778-aca1-f6341ff631fe tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:51.442304 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0089847d-1030-40ca-b174-fd695429b3c5 req-8f57044a-349c-4778-aca1-f6341ff631fe tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.0825968 May 25 15:42:51.481354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670d2182-4567-43e1-ae45-9a17978d4a4b req-cde07bc1-df39-4e12-894e-cb260fcb570d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:51.482800 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-670d2182-4567-43e1-ae45-9a17978d4a4b req-cde07bc1-df39-4e12-894e-cb260fcb570d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0832858 May 25 15:42:51.487435 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0089847d-1030-40ca-b174-fd695429b3c5 req-7fb7fe8e-5251-4671-a800-579d2755f218 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395184 May 25 15:42:51.527053 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-670d2182-4567-43e1-ae45-9a17978d4a4b req-03934109-3a73-4120-9db5-36446bab75d4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384696 May 25 15:42:51.804550 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5971a298-dd72-433a-b15e-626dce746fde req-419d6301-afdd-4c9c-b629-be23de457ded tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:51.805958 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5971a298-dd72-433a-b15e-626dce746fde req-419d6301-afdd-4c9c-b629-be23de457ded tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.0837128 May 25 15:42:51.850704 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5971a298-dd72-433a-b15e-626dce746fde req-a0cff1f7-0160-431a-84dc-6d7840feed6a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391662 May 25 15:42:51.993325 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 req-e16824ea-4d97-4e65-bd55-7297f9bddf45 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:51.994768 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 req-e16824ea-4d97-4e65-bd55-7297f9bddf45 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0772135 May 25 15:42:52.106957 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5b094cd7-66dd-4487-a6ba-38e9604b91b4 req-119cc4ec-0ce7-4d37-a0ce-bc6e41234328 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1063380 May 25 15:42:52.351245 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:42:52.418718 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 3f734a1c-be04-4203-b351-6b0b6785f9ae triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:42:52.419085 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.531712 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.560372 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:52.571213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:52.575034 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:52.576899 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:52.641897 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=7']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:52.645577 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:52.674250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 req-456b9e6b-d382-466a-a2e6-06ee923d120a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:52.675825 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 req-456b9e6b-d382-466a-a2e6-06ee923d120a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.0808830 May 25 15:42:52.718939 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 req-1c4a9e7e-a3ed-487d-934e-678e57eb3ef7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:52.720415 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 req-1c4a9e7e-a3ed-487d-934e-678e57eb3ef7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0819805 May 25 15:42:52.720858 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7673cba6-ce58-43a2-9c55-1dc71425a8a9 req-c24954da-7e77-4feb-8cc2-6ad8ef07caf5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385323 May 25 15:42:52.766699 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b72c7e3-da97-4a4a-948a-bf7fe4a49831 req-d8a852f3-c6bd-4263-91fa-11015e4ef5a2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405130 May 25 15:42:52.780174 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'code': 200} May 25 15:42:53.054804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 req-24b6fcb4-edbd-4bb1-8d44-b9ac8ca17f73 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:53.056293 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 req-24b6fcb4-edbd-4bb1-8d44-b9ac8ca17f73 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0855403 May 25 15:42:53.100713 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a2c5ceaa-38e9-48ff-af42-ee1966e18372 req-0790e31a-232a-45d9-85a9-8ffcded5f6fa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388496 May 25 15:42:53.299423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762cff27-1dc4-43b0-907e-4c3751f04305 req-9caf6b18-eb52-40a6-943f-643e15525770 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:53.301598 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-762cff27-1dc4-43b0-907e-4c3751f04305 req-9caf6b18-eb52-40a6-943f-643e15525770 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0863867 May 25 15:42:53.349057 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-762cff27-1dc4-43b0-907e-4c3751f04305 req-31ddea44-5c42-42b8-89d8-1eae2505ef0b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415576 May 25 15:42:53.939070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 req-6c9895a6-a21d-472d-bb85-a325ff7f56bd tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:53.946912 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 req-6c9895a6-a21d-472d-bb85-a325ff7f56bd tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.1053805 May 25 15:42:53.990442 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2e67ac92-8aa7-46d2-a863-18f6bf8f3742 req-a462ad5c-faa9-4bc0-9842-6bbe9dc1fc48 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426714 May 25 15:42:53.993796 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 req-54216214-1d21-46ff-a320-a6881625bec8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.001095 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 req-54216214-1d21-46ff-a320-a6881625bec8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1078327 May 25 15:42:54.091019 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bbcffc59-3368-4d0c-94a0-9c477b3b5ca3 req-759176ca-e551-4f86-a895-7b19bf60c5cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887828 May 25 15:42:54.321263 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f42e8be-030b-4f88-8389-c76a28d71552 req-ae17b840-9da7-487e-b6ea-ab6c1532bb0a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.321950 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f42e8be-030b-4f88-8389-c76a28d71552 req-ae17b840-9da7-487e-b6ea-ab6c1532bb0a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0939293 May 25 15:42:54.368772 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f42e8be-030b-4f88-8389-c76a28d71552 req-fca5120b-4fa9-45d2-a0e9-04e8f5eaa810 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412245 May 25 15:42:54.584734 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-869dc3f6-2dad-4739-8645-a3541e46435d req-1021db2e-b29b-48c8-a122-d9c27b84d782 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.586237 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-869dc3f6-2dad-4739-8645-a3541e46435d req-1021db2e-b29b-48c8-a122-d9c27b84d782 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0998240 May 25 15:42:54.622876 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-a7d73a77-14f5-4517-a2d4-ca5fdc3388ae tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:54.624389 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-a7d73a77-14f5-4517-a2d4-ca5fdc3388ae tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.1028962 May 25 15:42:54.645916 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-869dc3f6-2dad-4739-8645-a3541e46435d req-588e9648-bde3-42d8-a3e6-ae710c9da54f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499153 May 25 15:42:54.875545 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Deleting port 36833437-89ff-4bb3-978e-a332e89af2e5 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:42:54.876364 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:55.032686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] For port 36833437-89ff-4bb3-978e-a332e89af2e5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=36833437-89ff-4bb3-978e-a332e89af2e5,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:42:55.033113 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:55.190033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling delete_port for 36833437-89ff-4bb3-978e-a332e89af2e5 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:42:55.312124 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3618a645-b958-4959-b119-42bc0dd2f367 req-31d6b949-4d3c-424d-b3a4-e42f02f9a8ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.313631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3618a645-b958-4959-b119-42bc0dd2f367 req-31d6b949-4d3c-424d-b3a4-e42f02f9a8ab tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 946 time: 0.1331875 May 25 15:42:55.328152 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48cd846-f828-42af-a252-60fe7202975e req-b6bfde29-b99e-43d0-88cd-f8f0f2ea968d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.329963 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b48cd846-f828-42af-a252-60fe7202975e req-b6bfde29-b99e-43d0-88cd-f8f0f2ea968d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0985756 May 25 15:42:55.389415 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b48cd846-f828-42af-a252-60fe7202975e req-352a429d-4bf7-4ff9-a750-a856d8cbed63 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524831 May 25 15:42:55.433457 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3618a645-b958-4959-b119-42bc0dd2f367 req-068618fb-bead-436a-a900-c096bb9d2e54 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1134932 May 25 15:42:55.446809 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:55.455701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3666e891-7b30-47de-8a49-b1ca2652fe97 tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:42:55.464057 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['36833437-89ff-4bb3-978e-a332e89af2e5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:42:55.517593 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Pushing event deleted for resources: {'Port': ['ID=36833437-89ff-4bb3-978e-a332e89af2e5,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:42:55.575223 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.575584 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.575981 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.576335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.576686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.577030 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.577371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.577707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.578052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.578388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.578728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.579061 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:42:55.638445 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:42:55.649607 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] No DVR routers for this DVR port 36833437-89ff-4bb3-978e-a332e89af2e5 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:42:55.653702 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:42:55.659132 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'name': 'network-vif-deleted', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:42:55.683896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 req-6696eb25-3705-433c-a137-533026c26a63 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.693932 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8b9344c8-7c5c-4bc5-8e87-0405cdfc381b req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "DELETE /v2.0/ports/36833437-89ff-4bb3-978e-a332e89af2e5 HTTP/1.1" status: 204 len: 173 time: 1.0604928 May 25 15:42:55.694468 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 req-6696eb25-3705-433c-a137-533026c26a63 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.1298418 May 25 15:42:55.758150 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eba85bae-2d36-44bc-8f2c-b4eaaa6f3fc8 req-4b7ec012-a0c1-421e-858d-4664ae0efcde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0626261 May 25 15:42:55.828036 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3f388fe6-4e89-48f0-bf54-e1ff840faed9', 'name': 'network-vif-deleted', 'tag': '36833437-89ff-4bb3-978e-a332e89af2e5', 'status': 'completed', 'code': 200} May 25 15:42:55.963544 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-044f3476-4369-4685-81d5-e273ecbfa98e req-64cd09a8-b35f-41c9-b456-346081dd3f7e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:55.965343 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-044f3476-4369-4685-81d5-e273ecbfa98e req-64cd09a8-b35f-41c9-b456-346081dd3f7e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1156261 May 25 15:42:56.027345 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-044f3476-4369-4685-81d5-e273ecbfa98e req-e511ddfe-b281-4d4a-9bc3-47e9b8c21f5f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557082 May 25 15:42:56.661271 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de req-590d35f0-31b6-44d2-b313-f4b642ea1d54 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:56.662756 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de req-590d35f0-31b6-44d2-b313-f4b642ea1d54 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1283851 May 25 15:42:56.680484 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b req-0ef893f7-f130-4fad-931d-8fc16748ee5c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Synchronizing usage tracker for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:42:56.703558 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b req-0ef893f7-f130-4fad-931d-8fc16748ee5c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Unset dirty status for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:42:56.705685 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4409dcec-ad84-46ba-b8c8-0ed2d02e154b req-0ef893f7-f130-4fad-931d-8fc16748ee5c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=3f388fe6-4e89-48f0-bf54-e1ff840faed9 HTTP/1.1" status: 200 len: 210 time: 0.0910625 May 25 15:42:56.739061 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0fbdbfbf-7fce-4e15-a8f2-3de0de31e7de req-1133acf0-d7da-4da3-8a00-42a100ff75b1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695195 May 25 15:42:56.992389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d07266c-a42a-405b-9868-158fc0bf2738 req-813d2429-002a-4858-9a74-bcfc309f92ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:56.994164 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2d07266c-a42a-405b-9868-158fc0bf2738 req-813d2429-002a-4858-9a74-bcfc309f92ce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0896442 May 25 15:42:57.058457 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2d07266c-a42a-405b-9868-158fc0bf2738 req-91530aee-5f46-454c-a56d-0e3ac890ca79 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0554585 May 25 15:42:57.239388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 req-75ce217b-08d2-4249-8e41-fe11ad630940 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.241209 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 req-75ce217b-08d2-4249-8e41-fe11ad630940 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0873470 May 25 15:42:57.290427 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d8df344e-e082-4026-aff5-e1ad5e0ba5a7 req-e93cab73-8fa0-4c18-8e4c-ed88646314e3 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433040 May 25 15:42:57.954382 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00535a13-4163-4c8d-8bda-4e613284d9d8 req-313e2e80-40a8-48cc-904f-57c33c1da5df tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:57.956037 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-00535a13-4163-4c8d-8bda-4e613284d9d8 req-313e2e80-40a8-48cc-904f-57c33c1da5df tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0895970 May 25 15:42:58.005198 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-00535a13-4163-4c8d-8bda-4e613284d9d8 req-56c8b806-e857-4522-b9f0-842833293717 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428908 May 25 15:42:58.259519 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e req-38acc084-38a6-43b4-9b97-c755017a800b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:58.261443 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e req-38acc084-38a6-43b4-9b97-c755017a800b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0913997 May 25 15:42:58.316853 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-232ef919-1e5b-49bf-8aeb-1c1e482a9f0e req-a6606472-677d-4e92-bbc8-cbc48e3891c3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490541 May 25 15:42:58.397931 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 36833437-89ff-4bb3-978e-a332e89af2e5 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:42:58.455721 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 36833437-89ff-4bb3-978e-a332e89af2e5 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:42:58.456415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 36833437-89ff-4bb3-978e-a332e89af2e5 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:42:58.531974 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33445aa2-98ac-4820-80d2-2433b6ed4b99 req-fcc37055-0156-41d7-80b5-fa2cee0e2ea6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:58.533678 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-33445aa2-98ac-4820-80d2-2433b6ed4b99 req-fcc37055-0156-41d7-80b5-fa2cee0e2ea6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0886402 May 25 15:42:58.584276 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-33445aa2-98ac-4820-80d2-2433b6ed4b99 req-f8890ec5-bea0-4fa7-9cd0-6e47384fb9e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448370 May 25 15:42:59.216010 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 req-1cdde5dd-ccf1-4683-8d89-86bfa2c4fab2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.217701 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 req-1cdde5dd-ccf1-4683-8d89-86bfa2c4fab2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0898163 May 25 15:42:59.271183 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-08d72246-4e4e-4be9-8a14-ccd48e2028d6 req-ecbbd28e-256c-4798-8c3a-3ae7660fcd6d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463443 May 25 15:42:59.534295 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 req-ee7973d0-2edc-4c11-ab3b-d7fede2cff0a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.534295 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 req-ee7973d0-2edc-4c11-ab3b-d7fede2cff0a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0979342 May 25 15:42:59.580753 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ee93fc01-6f5f-433f-8b7f-0d8d1df48315 req-0fe76986-332d-4401-93db-ea3926597212 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414231 May 25 15:42:59.811659 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85db1467-7f5f-42c1-85d8-9143b5fa237f req-d5bdc6ab-48af-4aba-8ef1-511c4746a8f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:42:59.815682 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-85db1467-7f5f-42c1-85d8-9143b5fa237f req-d5bdc6ab-48af-4aba-8ef1-511c4746a8f9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1165595 May 25 15:42:59.860393 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-85db1467-7f5f-42c1-85d8-9143b5fa237f req-b31025b9-2259-41c3-85d7-68db2db9fcc1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442700 May 25 15:42:59.977753 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-26807b78-db69-4ad1-bafc-d36de1a3f265 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:00.491730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc req-04a6cc74-fd8a-4964-b3d0-765b1b2b481c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:00.493419 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc req-04a6cc74-fd8a-4964-b3d0-765b1b2b481c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0858951 May 25 15:43:00.550453 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bb1248f2-885a-4dd7-8f3b-0c51e07c08fc req-a205177c-a1bc-46ed-97b4-55487b0d5801 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509431 May 25 15:43:00.811649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b req-1282d4a8-d347-4f81-b6d3-7b6b11156789 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:00.816416 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b req-1282d4a8-d347-4f81-b6d3-7b6b11156789 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0905814 May 25 15:43:00.866289 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6239fbde-7f40-4a3d-9ae6-bf80f772cd3b req-912e65b2-9383-423a-a1e0-d861d8bc836e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464010 May 25 15:43:01.073306 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7a575f-c3a4-4b60-92e5-47787e331117 req-e042f71e-397e-4c76-973d-080e7979d149 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.074697 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3c7a575f-c3a4-4b60-92e5-47787e331117 req-e042f71e-397e-4c76-973d-080e7979d149 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1050625 May 25 15:43:01.130779 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3c7a575f-c3a4-4b60-92e5-47787e331117 req-49499e30-2fd3-43a7-8c04-5bf28c3a3e1c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494947 May 25 15:43:01.746683 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e req-823cb1ea-6800-4387-a589-15755a7a4a54 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:01.748083 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e req-823cb1ea-6800-4387-a589-15755a7a4a54 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0831621 May 25 15:43:01.802070 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f9a54e34-4e87-4c21-b71b-d4dfb3b2176e req-05d98f65-8f38-4985-8bcb-0aa0f2d75f58 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450964 May 25 15:43:02.255174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce013ded-af42-4320-97fc-12d5cc85ad22 req-51bfd350-d95a-4b04-9336-0d6e687792a5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.257463 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ce013ded-af42-4320-97fc-12d5cc85ad22 req-51bfd350-d95a-4b04-9336-0d6e687792a5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.2510521 May 25 15:43:02.314179 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ce013ded-af42-4320-97fc-12d5cc85ad22 req-45bad153-cbb6-4d8f-84d6-10e8f5aeec16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490069 May 25 15:43:02.553859 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-24cfdc7c-3765-4c4e-98d5-35049bc4b85f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.554849 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-24cfdc7c-3765-4c4e-98d5-35049bc4b85f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 809 time: 0.2015321 May 25 15:43:02.570210 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-59f94a9d-8432-4714-901a-da9ff91c00eb tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/quotas/b4d6b8a11a0d4e2c97f55bde6cd2c234 HTTP/1.1" status: 200 len: 375 time: 0.0093777 May 25 15:43:02.582233 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f req-fff2dfbd-fb44-4acd-8e28-d03a87cab9fc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:02.584377 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f req-fff2dfbd-fb44-4acd-8e28-d03a87cab9fc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0881181 May 25 15:43:02.633926 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:02.642941 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-55daac09-23e6-417a-900e-4a41d00c222e tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0664253 May 25 15:43:02.657817 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d0e822f1-fb8f-45f2-9f22-c6bd7c20d37f req-d5e3f02c-d3ce-4b61-acd2-beefbe835041 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669980 May 25 15:43:02.680509 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-83100198-a8a4-4f0d-ab64-57f2a2bfa92b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:02.812111 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-a0a514a6-75c4-45d4-a98c-b7c735ff69e0 service neutron] 10.222.0.36 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1648164 May 25 15:43:02.996151 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-869bad82-99b3-40a4-a264-181680483b6c service neutron] 10.222.0.36 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1862714 May 25 15:43:03.216475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-e6260ec3-a365-4c96-97a5-b4cd964cd915 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.218339 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-e6260ec3-a365-4c96-97a5-b4cd964cd915 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.1138303 May 25 15:43:03.248055 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0957d995-1e74-40ab-907d-221398b6e4f2 req-1814a720-590e-4ff6-b013-bce9c6c39e7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.255494 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0957d995-1e74-40ab-907d-221398b6e4f2 req-1814a720-590e-4ff6-b013-bce9c6c39e7a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1312621 May 25 15:43:03.311845 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0957d995-1e74-40ab-907d-221398b6e4f2 req-1dc347fd-0df5-4a35-b200-50fa054df87e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540683 May 25 15:43:03.440355 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:03.456012 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3f2969a5-5fa6-4b64-8b08-2f86072dc25f req-52edf045-78b2-48f0-8382-042cf7b52604 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 210 time: 0.0782106 May 25 15:43:03.618664 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-a2976ff9-0b4b-4aef-b49d-08bfa48102c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.620156 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-a2976ff9-0b4b-4aef-b49d-08bfa48102c2 service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.3903813 May 25 15:43:03.629088 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-405123d7-9a2c-44ab-bc91-7eb016cb494a req-409ec324-08ae-4f4b-bc68-5b6aa45af832 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.630545 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-405123d7-9a2c-44ab-bc91-7eb016cb494a req-409ec324-08ae-4f4b-bc68-5b6aa45af832 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1545684 May 25 15:43:03.631407 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578b3f2a-9cef-4014-a7f5-322e048e144f req-36d13735-2f5a-4cab-8878-daebfee17064 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.633104 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-578b3f2a-9cef-4014-a7f5-322e048e144f req-36d13735-2f5a-4cab-8878-daebfee17064 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0893288 May 25 15:43:03.685076 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-578b3f2a-9cef-4014-a7f5-322e048e144f req-26c437ca-4f67-4ec1-9ea0-3e71440727fb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416908 May 25 15:43:03.766276 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-405123d7-9a2c-44ab-bc91-7eb016cb494a req-d2bce100-0d19-46a3-b641-59f8f9549743 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0807140 May 25 15:43:03.768114 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-1588471b-d477-4d9d-8871-c529f327040a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1001 time: 0.1366470 May 25 15:43:03.952191 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-0364232c-7b26-41e4-909e-909d68fcfa3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:03.953719 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-0364232c-7b26-41e4-909e-909d68fcfa3d service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0586705 May 25 15:43:04.040069 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-8722bb81-ffba-4952-b6e8-a3b5c9cf1368 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.041569 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-8722bb81-ffba-4952-b6e8-a3b5c9cf1368 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0746999 May 25 15:43:04.208314 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-aa23e0a3-b950-4282-a591-cc988fb6e5ec service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1265411 May 25 15:43:04.429204 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa9a5388-3bc4-4990-9608-f55c8bcbb6ac req-a9b34c16-a349-4e60-9315-34a786710a21 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1850224 May 25 15:43:04.431914 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-d34d113f-243f-40e0-a996-f45dedcf6bdc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.433241 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-d34d113f-243f-40e0-a996-f45dedcf6bdc service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1099 time: 0.1698408 May 25 15:43:04.502317 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe5a45a-ed78-4821-82f3-2815c4117f15 req-f692f32f-6d26-4a06-bda5-4fbf215d1e28 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.503970 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2fe5a45a-ed78-4821-82f3-2815c4117f15 req-f692f32f-6d26-4a06-bda5-4fbf215d1e28 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0818241 May 25 15:43:04.554115 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2fe5a45a-ed78-4821-82f3-2815c4117f15 req-dd43196e-4ade-4521-a81f-c1ab4d3aed80 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440860 May 25 15:43:04.615168 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7b27abf4-4efa-4c3b-9a9b-dbfd49d3328d req-cc9ade89-d442-45cf-9f34-22f1da1327a9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 210 time: 0.0538592 May 25 15:43:04.635101 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-b22d69b2-c732-4ad8-a4f4-4ffdc6fcdc06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.636882 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-b22d69b2-c732-4ad8-a4f4-4ffdc6fcdc06 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1887891 May 25 15:43:04.757943 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-13dd5994-0d7e-4e3d-af90-035f7ad1cc27 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 1002 time: 0.1097500 May 25 15:43:04.838676 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-d3f688c2-ec82-4e6b-82f6-313a53a9600c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.840188 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-d3f688c2-ec82-4e6b-82f6-313a53a9600c service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0725782 May 25 15:43:04.897889 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b req-586ad22d-e6f0-4e37-aa9e-77879084354e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.899464 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b req-586ad22d-e6f0-4e37-aa9e-77879084354e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0783856 May 25 15:43:04.944030 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-21ffc777-6e8a-450f-8dd0-f61f02c81c9b req-f4ae4001-05ce-40c5-af47-3298ed59e834 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390089 May 25 15:43:04.962650 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a476343e-0650-4d05-a1aa-266b34120de7 req-a0df5cf3-c302-408a-9459-972e422c67a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:04.964128 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a476343e-0650-4d05-a1aa-266b34120de7 req-a0df5cf3-c302-408a-9459-972e422c67a5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0808730 May 25 15:43:05.072682 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a476343e-0650-4d05-a1aa-266b34120de7 req-68bc7dd7-86ad-479c-aa1c-70d50f930c98 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1028857 May 25 15:43:05.154981 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.205698 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-156262be-48c1-425a-ad03-1db9fd7a48d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.207460 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-156262be-48c1-425a-ad03-1db9fd7a48d4 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2001297 May 25 15:43:05.215839 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-ac332395-ff49-4887-9434-fb2ca028668c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.217244 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-ac332395-ff49-4887-9434-fb2ca028668c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 809 time: 0.2087994 May 25 15:43:05.257145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Request body: {'port': {'device_id': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9', 'admin_state_up': True, 'tenant_id': 'b4d6b8a11a0d4e2c97f55bde6cd2c234'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:05.562010 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-d3e7105b-c922-4e1e-8c92-91064cb908a9 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3283021 May 25 15:43:05.567102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:05.576601 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:05.657785 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Made reservation on behalf of b4d6b8a11a0d4e2c97f55bde6cd2c234 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:43:05.661477 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:05.780125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbed41d5-6d53-4505-a268-1f38362c701a req-84919996-c7a5-4492-84ff-dfce58f84e4f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:05.781589 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbed41d5-6d53-4505-a268-1f38362c701a req-84919996-c7a5-4492-84ff-dfce58f84e4f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1169517 May 25 15:43:05.821364 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e12d1b62-f5cc-4da8-91d4-98b0bccb1990 req-4e4ff022-d03f-4eaf-9d35-554e4174f3ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 210 time: 0.0604208 May 25 15:43:05.828821 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbed41d5-6d53-4505-a268-1f38362c701a req-ec84f6da-95c6-4b05-9de5-e5ca54c19bfb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416167 May 25 15:43:05.839902 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-783f9242-872f-4bff-ab9d-9f140cf619e5 req-aa395c7f-1f0b-4789-9653-33c39023505d service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2610946 May 25 15:43:05.925772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Allocated IP 172.20.0.7 (71fe9388-47c1-4797-9687-8ab41ffa2ce9/be107ecb-f575-4897-918d-5ad5567180d0/b85f42e2-6150-40d8-a0ac-30b059e7807b) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:43:06.133683 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44db4336-f07c-406c-a591-57d43dcf2549 req-0f3e11b7-3a7c-4d4a-bdd6-5f6da30caaf4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:06.134373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.136235 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-44db4336-f07c-406c-a591-57d43dcf2549 req-0f3e11b7-3a7c-4d4a-bdd6-5f6da30caaf4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 946 time: 0.0792637 May 25 15:43:06.165854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.172157 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-394f097e-5f5a-42d5-9b41-c1d83ba76091 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.185299 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-44db4336-f07c-406c-a591-57d43dcf2549 req-e84e40e8-65b7-47c3-b710-952db98da880 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441704 May 25 15:43:06.290870 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:43:06.295096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:43:06.300404 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:43:06.324499 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Pushing event updated for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:06.327655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:06.371893 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:06.372419 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.395270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 req-01c4af7f-f5e9-4f63-a02e-81bafca61695 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:06.396807 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 req-01c4af7f-f5e9-4f63-a02e-81bafca61695 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1931293 May 25 15:43:06.423209 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1706104 May 25 15:43:06.444633 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Request body: {'port': {'device_id': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:06.464181 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:43:06.480110 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d55ce148-a8a9-42c7-b432-367aa8dd4d41 req-c06746e4-d67f-477d-b4f1-3293a32001c4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0773897 May 25 15:43:06.559731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.576360 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.603154 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:06.613000 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:06.617393 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:06.619214 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-0d8bb32b-6aa9-4a74-9ac0-015ea6bd48c3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:06.655195 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'code': 200} May 25 15:43:06.686263 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=8']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:06.693829 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.694199 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.694530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.694855 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.695174 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.695495 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.695811 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.696159 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.696474 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.696788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.697665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.697665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:06.701076 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.012474 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-86767bc4-acdd-4ab5-bcea-47fcdf821964 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1859102 May 25 15:43:07.015457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b85f42e2-6150-40d8-a0ac-30b059e7807b {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:07.021506 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea1ac86-6779-43f7-8061-8634efbed3c4 req-a2fef30e-c9b1-48f8-bf8d-583d59f2b568 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.023394 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8ea1ac86-6779-43f7-8061-8634efbed3c4 req-a2fef30e-c9b1-48f8-bf8d-583d59f2b568 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 931 time: 0.0848243 May 25 15:43:07.025562 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:07.045926 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Transition to ACTIVE for port object b85f42e2-6150-40d8-a0ac-30b059e7807b will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:43:07.072371 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8ea1ac86-6779-43f7-8061-8634efbed3c4 req-8b3c4fbd-671c-42d4-ac9b-575f17a5fdb0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421126 May 25 15:43:07.090020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:07.178498 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:07.246975 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 req-938f1b90-c979-4e34-b5be-9f08f7f35e92 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.248450 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 req-938f1b90-c979-4e34-b5be-9f08f7f35e92 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2994325 May 25 15:43:07.338235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Pushing event updated for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:07.346756 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.375626 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92685032-9561-4278-aff9-3b79f353198c req-da43f9eb-92df-4cac-8ecb-8373811ea8b8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.377123 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-92685032-9561-4278-aff9-3b79f353198c req-da43f9eb-92df-4cac-8ecb-8373811ea8b8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0811646 May 25 15:43:07.427691 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-92685032-9561-4278-aff9-3b79f353198c req-a21f9bc2-8cb1-49c0-ac13-b5ef5a118717 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440748 May 25 15:43:07.453446 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a7c97d39-b261-4c36-9fc5-71221ba6c3c4 req-8b2a395a-9d84-4bd8-b06d-7a10fc3a1177 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1454091 May 25 15:43:07.460030 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-45270210-47f8-49e8-b05c-85f7ca24080e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.461436 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-45270210-47f8-49e8-b05c-85f7ca24080e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 1099 time: 0.4102988 May 25 15:43:07.482839 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Attempting to bind port b85f42e2-6150-40d8-a0ac-30b059e7807b on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:43:07.483165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Attempting to bind port b85f42e2-6150-40d8-a0ac-30b059e7807b by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:43:07.483487 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Attempting to bind port b85f42e2-6150-40d8-a0ac-30b059e7807b on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:07.488624 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Port b85f42e2-6150-40d8-a0ac-30b059e7807b on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:43:07.488971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Attempting to bind port b85f42e2-6150-40d8-a0ac-30b059e7807b on network 71fe9388-47c1-4797-9687-8ab41ffa2ce9 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:07.493980 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 42, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:43:07.494309 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Checking segment: {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:43:07.494682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Bound using segment: {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:43:07.495097 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Bound port: b85f42e2-6150-40d8-a0ac-30b059e7807b, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 354, 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:43:07.495435 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:07.693158 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:43:07.695311 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-34116c8f-41b8-4f57-a0f5-2f0f2a2d74e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.696765 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-34116c8f-41b8-4f57-a0f5-2f0f2a2d74e1 service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.1928830 May 25 15:43:07.701996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:43:07.706614 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:07.711081 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d03bb9a6-2b0d-4e53-938b-91f6abb900da tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:07.827992 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-a8953e22-7262-470c-b7b8-699481027573 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c HTTP/1.1" status: 200 len: 217 time: 0.0861878 May 25 15:43:07.831836 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.832540 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:07.833840 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] 10.222.0.70 "PUT /v2.0/ports/b85f42e2-6150-40d8-a0ac-30b059e7807b HTTP/1.1" status: 200 len: 1093 time: 1.3930910 May 25 15:43:07.834293 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:07.890601 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Pushing event updated for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:07.895638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:07.902916 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b', 'status': 'completed', 'code': 200} May 25 15:43:07.958342 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-a7b7db2a-d2b9-420e-bc3b-b8ad283efbeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:07.959744 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-a7b7db2a-d2b9-420e-bc3b-b8ad283efbeb service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.1103029 May 25 15:43:08.025152 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-8ce3ea5c-f1eb-4201-8272-006e0998af76 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0440927 May 25 15:43:08.029472 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-29d53fa9-78ee-4525-b1a4-e821b2b8b6a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.030799 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-29d53fa9-78ee-4525-b1a4-e821b2b8b6a9 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 1096 time: 0.1180613 May 25 15:43:08.167043 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-077cb419-743c-45e5-b563-8268d05ada3d service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b HTTP/1.1" status: 200 len: 217 time: 0.1109910 May 25 15:43:08.316233 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-1e439d05-7fbb-45d9-a895-7834b083c3c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.317662 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-1e439d05-7fbb-45d9-a895-7834b083c3c9 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=be107ecb-f575-4897-918d-5ad5567180d0 HTTP/1.1" status: 200 len: 849 time: 0.1384184 May 25 15:43:08.325246 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-8f9b162b-601b-488b-9c54-efea96b89629 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2857890 May 25 15:43:08.344039 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b6a5adc-a13e-444a-b656-6eeb65292dab req-afd9ca5e-a458-4413-bd68-5baddbff0b0c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.344707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-9b6a5adc-a13e-444a-b656-6eeb65292dab req-afd9ca5e-a458-4413-bd68-5baddbff0b0c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Synchronizing usage tracker for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:08.414153 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-2fd73a42-9525-4a31-b0c6-c7def590d869 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=71fe9388-47c1-4797-9687-8ab41ffa2ce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0657716 May 25 15:43:08.499574 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-9b6a5adc-a13e-444a-b656-6eeb65292dab req-afd9ca5e-a458-4413-bd68-5baddbff0b0c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Unset dirty status for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:08.500738 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9b6a5adc-a13e-444a-b656-6eeb65292dab req-afd9ca5e-a458-4413-bd68-5baddbff0b0c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 943 time: 0.3243537 May 25 15:43:08.625405 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f6ec3e0-50db-4201-8d1c-6137742dba08 req-89046c19-7b73-4c12-b019-9bacdc2fb7ad tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.626868 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8f6ec3e0-50db-4201-8d1c-6137742dba08 req-89046c19-7b73-4c12-b019-9bacdc2fb7ad tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0834968 May 25 15:43:08.673225 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8f6ec3e0-50db-4201-8d1c-6137742dba08 req-c7695877-c2bf-4736-8f0a-050c59483738 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396104 May 25 15:43:08.746622 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9b6a5adc-a13e-444a-b656-6eeb65292dab req-4ca48743-0f26-4bef-87ce-7779454cc197 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2023549 May 25 15:43:08.748542 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d269440d-5b1c-401e-8329-ed7e5645a3a3 req-4efb7bcd-4f60-4430-9b53-f0674c0adfd8 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4013524 May 25 15:43:08.771705 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-ed95d027-2cd9-4b2b-8960-7d47dc1faf4f service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3089244 May 25 15:43:08.859180 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df4d4484-c971-4186-a9f7-deb439190b8f req-d5851f4f-aec1-4e41-94a4-55492200a030 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:08.860735 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-df4d4484-c971-4186-a9f7-deb439190b8f req-d5851f4f-aec1-4e41-94a4-55492200a030 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0863853 May 25 15:43:08.907679 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-df4d4484-c971-4186-a9f7-deb439190b8f req-7c18acb2-d8b9-422c-8f1a-1025524d2bd9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405791 May 25 15:43:08.919728 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-660d8b65-2dec-49f5-9e95-f99691f89b87 req-7a90f6d1-797c-4a17-b19d-a3befbd719c0 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1308022 May 25 15:43:09.064457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-a0a3192b-5a68-42f8-a39e-9ddfc193c173 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:09.066520 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-a0a3192b-5a68-42f8-a39e-9ddfc193c173 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 1096 time: 0.0780773 May 25 15:43:09.214115 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-1208e6b0-7cf6-4628-92bb-9b4c4355a39d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:09.216379 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-1208e6b0-7cf6-4628-92bb-9b4c4355a39d service neutron] 10.222.0.70 "GET /v2.0/networks?id=71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 200 len: 910 time: 0.1355710 May 25 15:43:09.302780 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-834937d9-75ef-4561-bf47-0fa50025aae5 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b HTTP/1.1" status: 200 len: 217 time: 0.0706818 May 25 15:43:09.391621 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-89f18b6e-5f65-4e47-bd4e-d617e3045ae6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1147553235&fields=id&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 267 time: 0.0904171 May 25 15:43:09.401730 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-ce1b0d81-cf11-43f3-ba5d-9672fcba3a9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:09.403102 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-ce1b0d81-cf11-43f3-ba5d-9672fcba3a9f service neutron] 10.222.0.70 "GET /v2.0/subnets?id=be107ecb-f575-4897-918d-5ad5567180d0 HTTP/1.1" status: 200 len: 849 time: 0.0806420 May 25 15:43:09.529590 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-360af4a4-e167-41ed-a030-f4b628f50360 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=71fe9388-47c1-4797-9687-8ab41ffa2ce9&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0997570 May 25 15:43:09.662095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-335e7fe4-f9e8-41d2-8bde-80a37372195d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:09.663518 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-335e7fe4-f9e8-41d2-8bde-80a37372195d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.2635322 May 25 15:43:09.695735 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-02743125-2f4c-4a18-86e6-f4ca7ccdbe80 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/quotas/8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 375 time: 0.0235741 May 25 15:43:09.749025 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-d71c839c-a541-4e53-a300-6c09beda71e6 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1950271 May 25 15:43:09.876761 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fafd203-ab97-4432-8d1b-81a4618d98bd req-ead5d167-fe38-48d5-b0d7-424c83c53e82 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:09.878241 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4fafd203-ab97-4432-8d1b-81a4618d98bd req-ead5d167-fe38-48d5-b0d7-424c83c53e82 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0793672 May 25 15:43:09.898964 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-deb21692-2061-4c96-9b4b-03ffc2510685 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1925266 May 25 15:43:09.907061 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d708410e-e3bf-430f-aabf-709c79bfa31f req-47ad88aa-3eba-4b91-b0f7-99e2594fa153 service neutron] 10.222.0.70 "GET /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1453805 May 25 15:43:09.923254 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4fafd203-ab97-4432-8d1b-81a4618d98bd req-259249e0-78f7-4258-a58a-5c156553365f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392275 May 25 15:43:10.044234 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-ca3577b7-ad55-4965-b220-5dbbc6f09503 service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1330302 May 25 15:43:10.121358 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 req-728aeffb-96aa-4071-a480-1027f857c7db tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.122824 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 req-728aeffb-96aa-4071-a480-1027f857c7db tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 943 time: 0.0889797 May 25 15:43:10.167667 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ff0129b0-a2d7-46df-bbfb-8fd52a1eb669 req-40220efb-37fd-4a37-82a2-6a7641fd7d43 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390742 May 25 15:43:10.177661 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-521c296b-4a88-4aaf-a21c-7501922f1642 service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1276085 May 25 15:43:10.341156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 req-e64bfe1b-f326-4be9-a19e-24950f16e285 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:10.342642 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 req-e64bfe1b-f326-4be9-a19e-24950f16e285 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0794992 May 25 15:43:10.388362 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-85231995-3e56-4633-bd2e-eed0b8a2d0f4 req-27035389-e432-498d-ad87-7ad10f0e4405 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399647 May 25 15:43:10.582047 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bd48399a-1e5f-494f-9313-ba1bb96b2120 req-78655f57-b0c1-4704-b7ca-5de3d13a8ced tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0473163 May 25 15:43:10.641466 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:10.675751 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:43:11.308077 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f795dded-741b-474e-ae5c-6a02a2a9d9cb req-b132ab30-2901-46bf-a47b-91a47fa16555 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:11.309673 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f795dded-741b-474e-ae5c-6a02a2a9d9cb req-b132ab30-2901-46bf-a47b-91a47fa16555 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0866427 May 25 15:43:11.355582 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f795dded-741b-474e-ae5c-6a02a2a9d9cb req-829cc828-9f32-4249-804e-a89ca0973fef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397358 May 25 15:43:11.369557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ed1435-ce2a-46e7-958b-26e78a4a883c req-6ed9df84-3207-40aa-919d-bc7b45821e39 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:11.371769 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1ed1435-ce2a-46e7-958b-26e78a4a883c req-6ed9df84-3207-40aa-919d-bc7b45821e39 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 943 time: 0.0895293 May 25 15:43:11.419519 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1ed1435-ce2a-46e7-958b-26e78a4a883c req-993c11e5-30cf-4825-9aa9-07066cbf64a3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408320 May 25 15:43:11.567586 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 44960) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:11.576785 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4312fc8a-1f43-4106-a662-db5422a62c5b req-a6292b99-c573-40f1-9c7f-0417c17320c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:11.578341 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4312fc8a-1f43-4106-a662-db5422a62c5b req-a6292b99-c573-40f1-9c7f-0417c17320c8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0790298 May 25 15:43:11.632381 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4312fc8a-1f43-4106-a662-db5422a62c5b req-ff50de2e-84a4-4281-8057-842bf16adbbd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479424 May 25 15:43:11.835972 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a514961d-c782-4358-b67b-d286c601acbb req-1c03fab6-665c-4220-97aa-92dc43f79995 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0730491 May 25 15:43:11.944413 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-ddc8ed5d-67ab-4645-b498-daa0fa3bcf0b service neutron] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.3754804 May 25 15:43:11.975749 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-759340fe-e2e1-4afc-a09f-7c7028f73f4b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:11.977423 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-759340fe-e2e1-4afc-a09f-7c7028f73f4b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.1735015 May 25 15:43:12.034597 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-0f3dd476-ba90-474c-a105-f6aacbdccdc6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 380 time: 0.0451343 May 25 15:43:12.051555 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'port': {'device_id': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'admin_state_up': True, 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'security_groups': ['1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:12.207056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:12.210902 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:port and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:12.213782 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for port was recalculated. Used quota:2. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:12.219693 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:12.229767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Made reservation on behalf of 8dff1003ceba47f6a75b4c3901343b7b for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:43:12.233505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:12.409727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.20.0.6 (d8a04926-b628-40fa-a53b-51df7783813d/693414b7-eaf3-4626-b7cd-b644e55f5f70/746ae7a8-06cf-478c-b6d4-ecf4e9c02988) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:43:12.478836 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b85f42e2-6150-40d8-a0ac-30b059e7807b details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:43:12.607452 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1928c868-d747-422a-95e9-e4f2d5047313 req-6925d6c3-404b-462e-b857-4fa9f6d852a3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:12.609112 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1928c868-d747-422a-95e9-e4f2d5047313 req-6925d6c3-404b-462e-b857-4fa9f6d852a3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1352615 May 25 15:43:12.622980 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:43:12.668558 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1928c868-d747-422a-95e9-e4f2d5047313 req-fa2efebe-8363-4727-9e7f-c2c9fd4b3d95 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0530937 May 25 15:43:12.678034 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:12.678442 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:12.698138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Transition to ACTIVE for port object 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:43:12.702045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': 'b85f42e2-6150-40d8-a0ac-30b059e7807b', 'network_id': '71fe9388-47c1-4797-9687-8ab41ffa2ce9', 'port_id': 'b85f42e2-6150-40d8-a0ac-30b059e7807b', 'mac_address': 'fa:16:3e:b1:93:7b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 354, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'be107ecb-f575-4897-918d-5ad5567180d0', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:43:12.738327 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a req-a116deb5-04c2-4cbc-a00f-dcafddaafda9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:12.740242 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a req-a116deb5-04c2-4cbc-a00f-dcafddaafda9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 943 time: 0.1902745 May 25 15:43:12.770435 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:12.778332 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.846279 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:12.873512 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b85f42e2-6150-40d8-a0ac-30b059e7807b {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:12.875172 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:43:12.889582 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca971b7-ed7d-4c7d-bb05-9948fcaed56a req-ef28f5a1-1efd-475e-bc47-38a254c39eba tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1407280 May 25 15:43:12.892100 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:12.897613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:43:12.899948 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:12.907318 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:12.908716 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:12.913724 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:43:12.948418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:12.957261 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-761aebfc-13fb-4b31-a893-2d5f1adf9675 req-e2c8636f-0cbb-4a91-a39a-4be732a68d04 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:12.976767 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-761aebfc-13fb-4b31-a893-2d5f1adf9675 req-e2c8636f-0cbb-4a91-a39a-4be732a68d04 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2070065 May 25 15:43:13.013807 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:13.017935 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:13.023233 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:13.024061 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:13.051739 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0042505 May 25 15:43:13.060466 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-761aebfc-13fb-4b31-a893-2d5f1adf9675 req-f1edc1f7-871b-4e68-825d-77ea37d261a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825105 May 25 15:43:13.074859 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Request body: {'port': {'device_id': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:13.235582 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a0e854bd-c587-46f4-8eb1-f7d24fbcdcfe None None] Provisioning for port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:43:13.240404 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a0e854bd-c587-46f4-8eb1-f7d24fbcdcfe None None] Provisioning complete for port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:13.240779 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a0e854bd-c587-46f4-8eb1-f7d24fbcdcfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:13.249229 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:13.308232 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c0ec6e-7060-41ba-a800-980b1c3dba64 req-bc591987-02a5-44a8-a1de-155273e65f89 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:13.308925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-37c0ec6e-7060-41ba-a800-980b1c3dba64 req-bc591987-02a5-44a8-a1de-155273e65f89 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:13.315789 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-a0e854bd-c587-46f4-8eb1-f7d24fbcdcfe None None] Port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:43:13.333573 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['b85f42e2-6150-40d8-a0ac-30b059e7807b'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:13.349452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-37c0ec6e-7060-41ba-a800-980b1c3dba64 req-bc591987-02a5-44a8-a1de-155273e65f89 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:13.350543 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-37c0ec6e-7060-41ba-a800-980b1c3dba64 req-bc591987-02a5-44a8-a1de-155273e65f89 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 931 time: 0.2411425 May 25 15:43:13.471243 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-37c0ec6e-7060-41ba-a800-980b1c3dba64 req-741e8cee-1aab-4d04-aa5c-51481b076eea tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821977 May 25 15:43:13.653904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:13.661614 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:13.676423 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Transition to ACTIVE for port object 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:43:13.680117 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:13.684471 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3d25e78d-24a8-4058-a72d-42523bc8f2f5 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:13.889121 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed2a543-3c6d-4527-878f-81ce2db456f5 req-a2e6bebc-793a-4cad-ac58-df1471c0915d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:13.892551 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aed2a543-3c6d-4527-878f-81ce2db456f5 req-a2e6bebc-793a-4cad-ac58-df1471c0915d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1109338 May 25 15:43:13.942532 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aed2a543-3c6d-4527-878f-81ce2db456f5 req-26f0b0f5-bce3-4efd-9bab-54a41873319c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442762 May 25 15:43:13.943649 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Pushing event updated for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:13.951742 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.029125 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Attempting to bind port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:43:14.029720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Attempting to bind port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:43:14.030151 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Attempting to bind port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:14.035678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 on network d8a04926-b628-40fa-a53b-51df7783813d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:43:14.036143 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Attempting to bind port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:43:14.043309 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 43, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:43:14.043678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:43:14.044234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Bound using segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:43:14.044668 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Bound port: 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:43:14.045017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.202171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:43:14.205877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:43:14.210758 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.214988 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-07c3b90d-55ca-4ccf-a152-0e4b2212a6da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.256688 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d54fe24-3e49-4a1c-92b8-891121e92150 req-4b458e93-a99f-436b-9964-1b1a20d1106c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.258099 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d54fe24-3e49-4a1c-92b8-891121e92150 req-4b458e93-a99f-436b-9964-1b1a20d1106c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 944 time: 0.2159226 May 25 15:43:14.262739 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ea177c-92a3-4871-84bf-50a6338d577b req-67f0a5ac-d762-4793-a94d-5ac3b0c3bfb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.264329 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-80ea177c-92a3-4871-84bf-50a6338d577b req-67f0a5ac-d762-4793-a94d-5ac3b0c3bfb4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0943468 May 25 15:43:14.302545 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.303162 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.304554 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] 10.222.0.70 "PUT /v2.0/ports/746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 200 len: 1093 time: 1.2355757 May 25 15:43:14.306608 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:14.312522 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-80ea177c-92a3-4871-84bf-50a6338d577b req-8643f309-4f00-4c21-8ef4-9b1569ac5f49 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416689 May 25 15:43:14.337824 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Pushing event updated for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:14.342655 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.353806 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d54fe24-3e49-4a1c-92b8-891121e92150 req-e3932bee-d1c3-4018-984d-b2ac036fe4ad tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808237 May 25 15:43:14.405950 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'status': 'completed', 'code': 200} May 25 15:43:14.447896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-dd1394b2-5fde-49e3-848b-cf20e65c7fe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.449395 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-dd1394b2-5fde-49e3-848b-cf20e65c7fe5 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1096 time: 0.0791125 May 25 15:43:14.486727 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b85f42e2-6150-40d8-a0ac-30b059e7807b up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:43:14.529127 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-045ca4aa-1c75-4fc7-b181-413c84ea112e service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 200 len: 217 time: 0.0658526 May 25 15:43:14.560613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port b85f42e2-6150-40d8-a0ac-30b059e7807b completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:43:14.567833 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port b85f42e2-6150-40d8-a0ac-30b059e7807b triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:14.568226 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.645438 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5510fbf8-a39a-490d-bda6-edda422d6d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.646936 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-5510fbf8-a39a-490d-bda6-edda422d6d23 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.1080906 May 25 15:43:14.690102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.724584 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:14.728812 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e req-b56dbd01-de2c-47e9-81ab-3e8dc544d754 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.730301 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e req-b56dbd01-de2c-47e9-81ab-3e8dc544d754 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.1430049 May 25 15:43:14.734421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:14.739600 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:14.741748 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-23051e29-226b-4615-a1cb-6fe8533cef74 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:14.778586 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b', 'code': 200} May 25 15:43:14.812429 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:14.817640 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:14.834769 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1c0a94f8-f413-4c5c-bad8-54cd3cf3421e req-29bbec7d-a82b-4225-8916-1a758495ef94 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0955248 May 25 15:43:14.844866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-55f97e8d-cdee-4deb-ba97-ed529aa6bdbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.846296 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-55f97e8d-cdee-4deb-ba97-ed529aa6bdbd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1854236 May 25 15:43:14.891658 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-2136d3b6-f8c2-459d-8d40-6b967f7bfbc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:14.893142 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-2136d3b6-f8c2-459d-8d40-6b967f7bfbc4 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 1097 time: 0.1332018 May 25 15:43:15.110948 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-f932a2d4-e2ea-4d84-b6d8-01cfd85f0ceb service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2506852 May 25 15:43:15.124256 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-a8422bcf-f00b-4073-9323-04d59eddcec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.125927 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-a8422bcf-f00b-4073-9323-04d59eddcec8 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1097 time: 0.1863351 May 25 15:43:15.150675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1aace9a-3876-4df1-8a72-1d12057c5517 req-14639f9c-0def-4200-a64e-2cf43d41cabf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.152188 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d1aace9a-3876-4df1-8a72-1d12057c5517 req-14639f9c-0def-4200-a64e-2cf43d41cabf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0799255 May 25 15:43:15.200068 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d1aace9a-3876-4df1-8a72-1d12057c5517 req-3ae09daa-870a-40ed-9e1a-47b0b1aafb6c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413487 May 25 15:43:15.218313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3267524-a4df-4c24-b4c4-31df832b885c req-760270ec-072a-4ac4-94bb-317d8c13b1de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.219785 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a3267524-a4df-4c24-b4c4-31df832b885c req-760270ec-072a-4ac4-94bb-317d8c13b1de service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 1098 time: 0.2230511 May 25 15:43:15.385060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a3267524-a4df-4c24-b4c4-31df832b885c req-d802341f-0746-4c69-9240-575b8807b83e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112130 May 25 15:43:15.403885 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-978dddcc-6192-4323-bcbc-d03aefc004cd req-f015964b-7e4c-4d0e-8360-610da26b7b73 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2769976 May 25 15:43:15.408047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-97f25629-1916-49cf-9c0b-bb882f9be83a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.409426 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-97f25629-1916-49cf-9c0b-bb882f9be83a service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.2569554 May 25 15:43:15.540532 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 req-6382a75d-dbce-4a00-b030-957783c75b70 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.542001 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 req-6382a75d-dbce-4a00-b030-957783c75b70 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0851457 May 25 15:43:15.589746 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8f9b3e4c-85a8-45c4-9179-b3352c58c253 req-918764d6-44dd-4321-a801-cebbc42c33a6 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417168 May 25 15:43:15.717790 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6dab129-5c83-437a-812c-f0336603f691 req-5be10307-f578-4e4a-9109-278c80c74e16 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.719136 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e6dab129-5c83-437a-812c-f0336603f691 req-5be10307-f578-4e4a-9109-278c80c74e16 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2912674 May 25 15:43:15.754255 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-07da3b63-2099-4491-a4b1-a68f47254488 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 1000 time: 0.2598188 May 25 15:43:15.822102 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e6dab129-5c83-437a-812c-f0336603f691 req-5747c448-9134-446a-b6da-e01ea32f34c7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0941792 May 25 15:43:15.842229 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bec78b-60fc-413e-926a-b474954c7a72 req-dc819bbd-6f48-44bf-8e9d-de63d4573ed6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.843673 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-dc819bbd-6f48-44bf-8e9d-de63d4573ed6 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1096 time: 0.1881318 May 25 15:43:15.849249 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-c5578467-bbc0-4f4a-af4f-963b625a0ae1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:15.850550 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-c5578467-bbc0-4f4a-af4f-963b625a0ae1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0785861 May 25 15:43:16.022451 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-08b700b3-2c7c-4725-a8dc-0e1343442cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.023153 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-08b700b3-2c7c-4725-a8dc-0e1343442cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:16.035502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-08b700b3-2c7c-4725-a8dc-0e1343442cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:16.036645 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-08b700b3-2c7c-4725-a8dc-0e1343442cfe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0968039 May 25 15:43:16.045657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bec78b-60fc-413e-926a-b474954c7a72 req-ad4bfb99-4bdf-4cdd-a17a-b7b72e80c008 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.047080 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-ad4bfb99-4bdf-4cdd-a17a-b7b72e80c008 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1825936 May 25 15:43:16.049165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-dbf8f39a-2cc5-485b-afe9-61fa1b63182e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.050594 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-dbf8f39a-2cc5-485b-afe9-61fa1b63182e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1687732 May 25 15:43:16.079214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-015df76e-d3bd-4371-9514-d4fa6e863a67 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:16.095693 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-015df76e-d3bd-4371-9514-d4fa6e863a67 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:16.097544 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f8b7f973-7be4-4c23-96a8-59f2172cd6da req-015df76e-d3bd-4371-9514-d4fa6e863a67 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544944 May 25 15:43:16.151614 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-d5e5f875-34dd-43ea-806b-7826d8ae2460 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 200 len: 217 time: 0.0828011 May 25 15:43:16.284086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bec78b-60fc-413e-926a-b474954c7a72 req-de8ae278-3bbf-4da0-9f37-19c7205d1832 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.286028 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-de8ae278-3bbf-4da0-9f37-19c7205d1832 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0875318 May 25 15:43:16.346656 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-ae8fdb97-eb12-48c1-b463-aa993d682741 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2214415 May 25 15:43:16.509646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03bec78b-60fc-413e-926a-b474954c7a72 req-507f9aac-b039-4e0e-a1d1-bfcfd59a4d3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.511327 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-507f9aac-b039-4e0e-a1d1-bfcfd59a4d3b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2148254 May 25 15:43:16.615515 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5077d5fa-98e8-4053-a2d9-21806c7bb0b7 req-065fef8a-d4e0-4f16-9221-5e577e8c48da service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2558815 May 25 15:43:16.684448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f0a9789-4107-4fcd-ba50-52fea14346c5 req-72001feb-3f10-45b2-b84c-0cfb46e5782f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.685926 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5f0a9789-4107-4fcd-ba50-52fea14346c5 req-72001feb-3f10-45b2-b84c-0cfb46e5782f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.2115932 May 25 15:43:16.727547 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-26d5b8ec-d47c-43df-964c-e646e08e21f4 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2015560 May 25 15:43:16.737436 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5f0a9789-4107-4fcd-ba50-52fea14346c5 req-aa72a007-a41d-4345-b9b9-028100ede6ac tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430651 May 25 15:43:16.784692 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e958bb-1923-4390-b0cd-519951df91c0 req-89fcf39b-e018-47bc-b371-ed05a3148b35 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:16.786144 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-14e958bb-1923-4390-b0cd-519951df91c0 req-89fcf39b-e018-47bc-b371-ed05a3148b35 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0807409 May 25 15:43:16.831561 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-14e958bb-1923-4390-b0cd-519951df91c0 req-f265dd94-0481-46fd-90fd-0f045ff02f81 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395682 May 25 15:43:16.902453 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-03bec78b-60fc-413e-926a-b474954c7a72 req-7ccd92a7-19f8-4955-a9b7-5969cd27459a service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1335101 May 25 15:43:17.027109 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90637701-cb95-465e-95c2-4a92cf529fbc req-e0dc6f01-25c5-4935-8801-f17e33e283d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.028799 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-90637701-cb95-465e-95c2-4a92cf529fbc req-e0dc6f01-25c5-4935-8801-f17e33e283d5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0953290 May 25 15:43:17.073741 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-90637701-cb95-465e-95c2-4a92cf529fbc req-a9c04ee0-bc68-43e2-a6e2-ee76663a5cd4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392070 May 25 15:43:17.307402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adbcd548-2ad3-4523-beaf-f951d15a4387 req-b38e42db-d769-4ecc-b0ce-50548c0b33d6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.308935 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-adbcd548-2ad3-4523-beaf-f951d15a4387 req-b38e42db-d769-4ecc-b0ce-50548c0b33d6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0937989 May 25 15:43:17.367054 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-adbcd548-2ad3-4523-beaf-f951d15a4387 req-23ab7b24-a824-45ea-8f92-e24bb48217bc tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503483 May 25 15:43:17.940348 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c40ed2e-6978-435e-b700-237d530474a7 req-b8586266-7ef0-495c-8e37-f465b8fa2379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:17.941862 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4c40ed2e-6978-435e-b700-237d530474a7 req-b8586266-7ef0-495c-8e37-f465b8fa2379 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0860336 May 25 15:43:17.988225 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4c40ed2e-6978-435e-b700-237d530474a7 req-d4a45f63-7fa2-49f1-b21e-a8612a7aecd2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398359 May 25 15:43:18.032547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015e9e91-551b-48d3-8043-552605d03ca6 req-c778054a-367c-45e6-bcbf-c01a812d325b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:18.034000 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-015e9e91-551b-48d3-8043-552605d03ca6 req-c778054a-367c-45e6-bcbf-c01a812d325b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0937555 May 25 15:43:18.083752 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-015e9e91-551b-48d3-8043-552605d03ca6 req-a4b69d51-9427-4448-822c-8fd4df47ac70 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438883 May 25 15:43:18.275218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8f05cd-c169-4c2b-8977-0462fbb22159 req-9064d464-1381-4b5b-9bbc-e0b55cbc01cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:18.276757 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a8f05cd-c169-4c2b-8977-0462fbb22159 req-9064d464-1381-4b5b-9bbc-e0b55cbc01cb tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0861454 May 25 15:43:18.325684 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a8f05cd-c169-4c2b-8977-0462fbb22159 req-5c35e686-2577-4144-8097-484c4c82919c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427980 May 25 15:43:18.562900 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b66b11-026f-4051-956a-44fa40232020 req-828f15c7-3dd1-44a6-8902-20a42dbf6358 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:18.564404 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-86b66b11-026f-4051-956a-44fa40232020 req-828f15c7-3dd1-44a6-8902-20a42dbf6358 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0867445 May 25 15:43:18.612399 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-86b66b11-026f-4051-956a-44fa40232020 req-c36832db-4e96-47f4-bf57-4bac1bca1ccf tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417058 May 25 15:43:19.192590 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafd2787-21f0-4398-84e0-b33c732c765c req-f8b27cee-580c-4fae-8935-a199a8120750 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:19.201849 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cafd2787-21f0-4398-84e0-b33c732c765c req-f8b27cee-580c-4fae-8935-a199a8120750 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0988774 May 25 15:43:19.334815 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cafd2787-21f0-4398-84e0-b33c732c765c req-b1ef719c-f7b5-4274-bcf5-7dc59d84bda0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1321204 May 25 15:43:19.482793 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 req-dac2cc4f-4eaa-40ae-8cf3-bc14f6756b27 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:19.484411 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 req-dac2cc4f-4eaa-40ae-8cf3-bc14f6756b27 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0880222 May 25 15:43:19.532481 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9a95005d-a779-44b2-aaf7-fed7f6e645f4 req-3a05f764-918b-481d-a7b1-47d838f201b8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422556 May 25 15:43:19.533915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a0e3f4-5534-4348-84fd-e6517c59ee3a req-63acd342-3120-4dc8-a7c3-d0f3ee2481cd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:19.535932 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-15a0e3f4-5534-4348-84fd-e6517c59ee3a req-63acd342-3120-4dc8-a7c3-d0f3ee2481cd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0876920 May 25 15:43:19.586052 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-15a0e3f4-5534-4348-84fd-e6517c59ee3a req-884a0b4d-f137-4050-85d6-cb71b15922ab tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448163 May 25 15:43:19.802341 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-387666cc-8b42-4280-9ddc-0ff6458832dd req-8f8afcf7-c197-4038-9c0d-3f1824a0bcd3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:19.804369 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-387666cc-8b42-4280-9ddc-0ff6458832dd req-8f8afcf7-c197-4038-9c0d-3f1824a0bcd3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0835235 May 25 15:43:19.851128 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-387666cc-8b42-4280-9ddc-0ff6458832dd req-11633e55-4410-4fea-9f8a-2bb90d538ce3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410845 May 25 15:43:20.536368 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 req-183a4d52-b2ed-4395-9caa-a32951a6dedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:20.537835 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 req-183a4d52-b2ed-4395-9caa-a32951a6dedd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0852680 May 25 15:43:20.582471 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d444c26b-7982-47a7-9b83-ca27fad3dcb5 req-093df08d-6f41-444a-b19c-ea88de5f5f25 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389297 May 25 15:43:20.725386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 req-a66449b5-134f-4c6d-9904-29ff3f271b63 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:20.727069 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 req-a66449b5-134f-4c6d-9904-29ff3f271b63 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0875688 May 25 15:43:20.774450 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d6eae83d-40a9-4954-acd4-4e6d2bca8119 req-31f7c395-5b1b-4485-a1bd-881f4053d9ed tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415220 May 25 15:43:20.778924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e268f1d-9098-47e6-b110-148e4090962c req-cb1955d0-5d03-410e-909d-6777ca603a56 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:20.780442 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6e268f1d-9098-47e6-b110-148e4090962c req-cb1955d0-5d03-410e-909d-6777ca603a56 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0864577 May 25 15:43:20.835788 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6e268f1d-9098-47e6-b110-148e4090962c req-30011efa-d3a4-4f25-aa93-9006dc256a0d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489953 May 25 15:43:21.038580 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad8d5a7-2237-4038-ba11-591d591a2605 req-0a2fd74a-3deb-4edc-9b1b-e32293930dd4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:21.040096 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ad8d5a7-2237-4038-ba11-591d591a2605 req-0a2fd74a-3deb-4edc-9b1b-e32293930dd4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0800943 May 25 15:43:21.088054 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ad8d5a7-2237-4038-ba11-591d591a2605 req-6a545f92-e5c6-4a02-a1a3-3faeb504d546 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422788 May 25 15:43:21.780407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678f19de-dea0-495c-be7e-127db595db16 req-8e307e6f-5e6c-4d85-9580-95ba9d26a8da tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:21.781996 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-678f19de-dea0-495c-be7e-127db595db16 req-8e307e6f-5e6c-4d85-9580-95ba9d26a8da tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0825639 May 25 15:43:21.835589 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-678f19de-dea0-495c-be7e-127db595db16 req-e27ce1ba-22e8-4c2b-9dc6-67780dadc922 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468829 May 25 15:43:21.985578 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde req-56087c1a-0fc0-4c8f-a68e-3bc6892d1276 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:21.987214 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde req-56087c1a-0fc0-4c8f-a68e-3bc6892d1276 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0858140 May 25 15:43:22.032549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c165c4-fde9-4c46-90ad-7030baa08042 req-0d362dff-174a-4e31-8e0e-265a5d841dbe tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:22.033978 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-29abad3c-e5e8-4684-b0e8-1d9b98c48fde req-a529e45e-904e-4633-a3f4-76883b219dd4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408299 May 25 15:43:22.034151 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-14c165c4-fde9-4c46-90ad-7030baa08042 req-0d362dff-174a-4e31-8e0e-265a5d841dbe tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0877159 May 25 15:43:22.080026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-14c165c4-fde9-4c46-90ad-7030baa08042 req-c7cb6f0c-ba9f-4ff0-acfc-1665c5f818cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395808 May 25 15:43:22.278555 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2593957-044c-4c12-8dbd-d065675dde84 req-5f14f4b3-2d6b-4215-9d60-0f54e2af5212 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:22.285317 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e2593957-044c-4c12-8dbd-d065675dde84 req-5f14f4b3-2d6b-4215-9d60-0f54e2af5212 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0867636 May 25 15:43:22.327773 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e2593957-044c-4c12-8dbd-d065675dde84 req-784c2225-7ee5-4901-8ef5-1c8022195efb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414276 May 25 15:43:23.031711 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-154cb7bd-5444-4f8d-8fce-649f50fd333b req-daa808d6-3f0f-4d88-8569-a5d1d6a55c5b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:23.033244 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-154cb7bd-5444-4f8d-8fce-649f50fd333b req-daa808d6-3f0f-4d88-8569-a5d1d6a55c5b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0813992 May 25 15:43:23.082679 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-154cb7bd-5444-4f8d-8fce-649f50fd333b req-e0f77d75-a2a0-4afd-9979-d70e8c785c91 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432839 May 25 15:43:23.244805 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 req-242e6bfb-24e8-46fa-9564-2b2b316024a3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:23.246362 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 req-242e6bfb-24e8-46fa-9564-2b2b316024a3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0927389 May 25 15:43:23.285887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d26f941-c247-422a-9558-40c9d4767536 req-05c20067-2f08-48f6-817d-64578442475c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:23.287707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5d26f941-c247-422a-9558-40c9d4767536 req-05c20067-2f08-48f6-817d-64578442475c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0908818 May 25 15:43:23.292549 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-59ffa3e0-1b47-4469-90a7-cb251f6c1b00 req-ee112cf1-a644-4ee4-b09e-0ba9a65c6c3b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406206 May 25 15:43:23.332886 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5d26f941-c247-422a-9558-40c9d4767536 req-ce276757-8733-4d29-9b24-3dbd5b3172f4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394759 May 25 15:43:23.522156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3854f250-0b8e-45e4-b221-31af5e14dec5 req-83c19502-9f24-4dbd-8f50-4bda27886b52 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:23.523649 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3854f250-0b8e-45e4-b221-31af5e14dec5 req-83c19502-9f24-4dbd-8f50-4bda27886b52 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0858970 May 25 15:43:23.569222 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3854f250-0b8e-45e4-b221-31af5e14dec5 req-820ad4c4-2bb6-4b96-b437-a30fe82bea19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396245 May 25 15:43:24.289472 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f6389c9-581f-44ba-af3e-54ecb2309bbf req-8617b8ba-81ff-466a-ae0a-a599d6edcb3d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.290967 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4f6389c9-581f-44ba-af3e-54ecb2309bbf req-8617b8ba-81ff-466a-ae0a-a599d6edcb3d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0818858 May 25 15:43:24.338419 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4f6389c9-581f-44ba-af3e-54ecb2309bbf req-507ccbd4-0921-4de0-8764-9dc4324510cf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411365 May 25 15:43:24.483035 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a3c9732-5966-4410-a181-43344305fe38 req-30a4c2d7-80db-4a9a-8db5-559a48969c7b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.484571 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8a3c9732-5966-4410-a181-43344305fe38 req-30a4c2d7-80db-4a9a-8db5-559a48969c7b tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0830064 May 25 15:43:24.531192 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 req-6e49e189-42e6-439f-8ceb-92fb928d8490 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.532811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 req-6e49e189-42e6-439f-8ceb-92fb928d8490 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0893226 May 25 15:43:24.536455 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8a3c9732-5966-4410-a181-43344305fe38 req-bf014fe5-39fb-4cc1-8082-9fdee41383bc tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456207 May 25 15:43:24.579811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e12c1c2e-f94b-4371-a1c3-bbd211eac839 req-dc5f11e3-2117-4e23-8c3f-108868460a51 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404088 May 25 15:43:24.821993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dea96270-52d0-4916-9040-3f70db60c7ad req-81d2b7a6-29ff-4ca8-b305-f81a417e4e58 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:24.823509 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dea96270-52d0-4916-9040-3f70db60c7ad req-81d2b7a6-29ff-4ca8-b305-f81a417e4e58 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.1407948 May 25 15:43:24.869969 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dea96270-52d0-4916-9040-3f70db60c7ad req-164f90b5-a872-4475-b009-ff5ea299cb9d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405455 May 25 15:43:25.537778 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9d9b41-5334-4b31-891e-6cf7acf538cb req-b2cfee73-969b-4cc4-a8d8-1777617d9023 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.539264 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5b9d9b41-5334-4b31-891e-6cf7acf538cb req-b2cfee73-969b-4cc4-a8d8-1777617d9023 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0834665 May 25 15:43:25.589074 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5b9d9b41-5334-4b31-891e-6cf7acf538cb req-c72e9dca-dc90-46be-b08f-b6f0e9ad31d4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441473 May 25 15:43:25.737882 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a238758d-5c86-4f64-8106-a453cccf3eda req-247e1bad-c8f8-403b-b908-87e7a939e8e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.741284 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a238758d-5c86-4f64-8106-a453cccf3eda req-247e1bad-c8f8-403b-b908-87e7a939e8e7 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0928655 May 25 15:43:25.775766 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e req-d58131c0-683c-48a4-84b7-8e8bc4bd5ea8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:25.777934 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e req-d58131c0-683c-48a4-84b7-8e8bc4bd5ea8 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0840011 May 25 15:43:25.786658 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a238758d-5c86-4f64-8106-a453cccf3eda req-6c576f9e-6479-4e0b-b875-dbeefc7f6ffb tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414155 May 25 15:43:25.826335 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0a48df6b-70ad-41e1-bf03-f0def3e31d5e req-ecd2e955-d1c8-4cad-a726-731339ba27a2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431824 May 25 15:43:26.054963 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 req-02867451-7381-4f3a-a4dc-5921aeb067c7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:26.056371 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 req-02867451-7381-4f3a-a4dc-5921aeb067c7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0808623 May 25 15:43:26.105401 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb67d06c-9a7e-417e-a18c-dd8a5d651652 req-828569e3-dd37-45cd-a07c-ac62fd36e0db tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432892 May 25 15:43:26.782575 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-200ce340-9122-495d-bc8a-7fbd632873ed req-5a9a28af-55d0-4474-9b4a-c46f491b981b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:26.784068 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-200ce340-9122-495d-bc8a-7fbd632873ed req-5a9a28af-55d0-4474-9b4a-c46f491b981b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0842435 May 25 15:43:26.833024 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-200ce340-9122-495d-bc8a-7fbd632873ed req-a67a489a-b090-49de-8df5-c2cadbabb613 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430300 May 25 15:43:26.983252 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87f3a1c7-986d-4b58-8029-9ad9145a519b req-736dcda9-1140-444f-82fc-4731284d2f65 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:26.984692 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-87f3a1c7-986d-4b58-8029-9ad9145a519b req-736dcda9-1140-444f-82fc-4731284d2f65 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0827765 May 25 15:43:27.025114 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ede7900-dcac-4e99-a30e-631079ca6cd4 req-1b711c07-d4d8-47e3-94d3-c39eab6592b9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:27.026622 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5ede7900-dcac-4e99-a30e-631079ca6cd4 req-1b711c07-d4d8-47e3-94d3-c39eab6592b9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0867918 May 25 15:43:27.032290 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-87f3a1c7-986d-4b58-8029-9ad9145a519b req-89cc06d8-347a-464f-bf29-31bbbf30ca27 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411980 May 25 15:43:27.072770 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5ede7900-dcac-4e99-a30e-631079ca6cd4 req-ac9e24fb-305e-41c5-bc31-ec0f9316d6f5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392716 May 25 15:43:27.297163 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-482ccf50-3e4c-4527-817b-c93f973d5dee req-c162627b-c440-4145-972c-8c1b3bd5b649 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:27.298714 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-482ccf50-3e4c-4527-817b-c93f973d5dee req-c162627b-c440-4145-972c-8c1b3bd5b649 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0858908 May 25 15:43:27.343887 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-482ccf50-3e4c-4527-817b-c93f973d5dee req-bad97ab5-79e0-4965-9cd0-a35de3a54769 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394042 May 25 15:43:28.037691 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8cedec-fe85-4978-9993-95786b35ca3c req-2a311891-7171-4163-a422-3019600f12ef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:28.039299 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c8cedec-fe85-4978-9993-95786b35ca3c req-2a311891-7171-4163-a422-3019600f12ef tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0848067 May 25 15:43:28.084007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2c8cedec-fe85-4978-9993-95786b35ca3c req-fc048764-4f62-46d8-b5e7-ff6da97d1cde tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391650 May 25 15:43:28.222707 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 req-57fc6158-e3a7-4f80-80af-afa9983b8da4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:28.224310 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 req-57fc6158-e3a7-4f80-80af-afa9983b8da4 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0835929 May 25 15:43:28.265683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 req-eead1205-8e81-4a49-9665-6e3a10152de3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:28.267111 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 req-eead1205-8e81-4a49-9665-6e3a10152de3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0796068 May 25 15:43:28.276755 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9963e2fc-6a5c-4db7-90fc-5c3bcfe3aa02 req-61d1120f-73de-47df-8642-699263add4ea tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466423 May 25 15:43:28.320168 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c0b7f9cb-55a9-4673-90d4-b2b6497ba7f9 req-e99ba25c-8a4e-4118-ad29-d62626f83c91 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465522 May 25 15:43:28.546241 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 req-4c05fdae-f57d-4425-afc3-5c989555aecc tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:28.547808 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 req-4c05fdae-f57d-4425-afc3-5c989555aecc tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0926859 May 25 15:43:28.604702 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-de7cb8c8-2323-4ca1-9790-3308d970b8b4 req-196f00e6-1c89-4bff-aab3-453ef9b99613 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496831 May 25 15:43:28.685523 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63a78148-3bb0-4a32-8596-187dfc17fe42 req-97974c6d-fa70-41d3-8359-b0dfcf6c6b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:28.686961 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-63a78148-3bb0-4a32-8596-187dfc17fe42 req-97974c6d-fa70-41d3-8359-b0dfcf6c6b00 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0828629 May 25 15:43:28.733778 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-63a78148-3bb0-4a32-8596-187dfc17fe42 req-60a42c0b-4d8b-4f67-abfb-482136a390c0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0409589 May 25 15:43:29.287008 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 req-2648754d-3be5-40a9-a679-9218fd626388 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:29.288657 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 req-2648754d-3be5-40a9-a679-9218fd626388 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0891345 May 25 15:43:29.334585 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee9f5202-0708-4ea7-b2f2-db1d1db0b988 req-268baf6b-b5c7-4748-ba0d-7e652899822d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403292 May 25 15:43:29.472874 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a4b9781-5561-4537-965f-b851153dcbe8 req-7f6bd813-de80-4cdc-8ce0-b4281c92e663 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:29.474306 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1a4b9781-5561-4537-965f-b851153dcbe8 req-7f6bd813-de80-4cdc-8ce0-b4281c92e663 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0866821 May 25 15:43:29.521979 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1a4b9781-5561-4537-965f-b851153dcbe8 req-aed6edb7-8638-4092-b92e-f37c72e1fa34 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396962 May 25 15:43:29.522225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2193bb60-2e61-45cb-a345-1107c604f8f2 req-0198dbd6-ed75-4796-88df-1649d23afa63 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:29.524063 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2193bb60-2e61-45cb-a345-1107c604f8f2 req-0198dbd6-ed75-4796-88df-1649d23afa63 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0882816 May 25 15:43:29.576931 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2193bb60-2e61-45cb-a345-1107c604f8f2 req-82673425-0810-49fe-b04f-37946d5d8105 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469327 May 25 15:43:29.798089 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e55a5401-19f5-4a37-af06-d20ef6edab8d req-f8af235e-2acf-47ef-926c-d7a607771a69 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:29.799725 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e55a5401-19f5-4a37-af06-d20ef6edab8d req-f8af235e-2acf-47ef-926c-d7a607771a69 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0876873 May 25 15:43:29.846258 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e55a5401-19f5-4a37-af06-d20ef6edab8d req-fb66668e-c9ae-4f33-8f0c-8da82e171bea tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405202 May 25 15:43:29.972718 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0582c6d6-e12c-450b-a42b-27465437f9fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:30.004930 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f4b569-c36f-44c2-9fca-c587d519f316 req-e8ea06c8-e8ec-44bf-aa5d-6cfa575dcafe tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.006413 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-63f4b569-c36f-44c2-9fca-c587d519f316 req-e8ea06c8-e8ec-44bf-aa5d-6cfa575dcafe tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1628127 May 25 15:43:30.054637 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-63f4b569-c36f-44c2-9fca-c587d519f316 req-3282b9dc-db3b-4d16-82fc-f6b4df2a5751 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0421534 May 25 15:43:30.528613 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3a0417-7b45-4718-808f-f594cfb9ac10 req-2dbc7bad-1f86-4de5-92bb-a6f3e1956354 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.530095 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3e3a0417-7b45-4718-808f-f594cfb9ac10 req-2dbc7bad-1f86-4de5-92bb-a6f3e1956354 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0805211 May 25 15:43:30.579331 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3e3a0417-7b45-4718-808f-f594cfb9ac10 req-1ac1f1f9-42b5-4d25-9253-801c207f5a22 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430517 May 25 15:43:30.719288 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7451e136-cba7-49ed-86a6-1eec1345c49c req-a8d4c3af-fe04-44e5-88ce-80a3e84b98f0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.720778 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7451e136-cba7-49ed-86a6-1eec1345c49c req-a8d4c3af-fe04-44e5-88ce-80a3e84b98f0 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0821056 May 25 15:43:30.777103 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7451e136-cba7-49ed-86a6-1eec1345c49c req-c4d158a3-65c3-4da1-af89-bd0449d93e6f tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502799 May 25 15:43:30.780878 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e req-a9af199e-433e-4b45-b7f5-79e54ca14c41 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:30.782534 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e req-a9af199e-433e-4b45-b7f5-79e54ca14c41 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0858803 May 25 15:43:30.828895 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8dc88bd0-d0a6-491b-81f6-4b6d1c719a5e req-1ddf6d09-9048-47a9-8700-6b939fd4ef73 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403194 May 25 15:43:31.039534 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 req-19949272-3741-426d-9d45-25bf1c80d365 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:31.041025 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 req-19949272-3741-426d-9d45-25bf1c80d365 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0855801 May 25 15:43:31.086631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b3476f5b-c81a-4e02-8bc4-b720a0cbb2e2 req-f7f6a869-9dca-41f6-a2a2-f051ff3faa50 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398176 May 25 15:43:31.248239 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 req-403d5a5c-ec2b-4364-8518-6112208724ca tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:31.249704 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 req-403d5a5c-ec2b-4364-8518-6112208724ca tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0850425 May 25 15:43:31.298487 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-75d3ca31-e5aa-48d9-b5ee-d29df1b786d0 req-871654e3-97c2-4986-938a-335ef5453bfd tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0425837 May 25 15:43:31.778596 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad563053-50ff-4f88-8718-0e3762d4cbe7 req-93d38b22-547b-4370-b109-d7a5b8b3af69 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:31.780092 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ad563053-50ff-4f88-8718-0e3762d4cbe7 req-93d38b22-547b-4370-b109-d7a5b8b3af69 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0880630 May 25 15:43:31.827740 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ad563053-50ff-4f88-8718-0e3762d4cbe7 req-9a188f13-47bd-4843-8ddf-a37cb6085692 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413628 May 25 15:43:31.972839 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6475c269-af20-400d-85fb-bf54b3f05ca2 req-309521d6-8af6-41db-a2a0-2007d12f035c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:31.974290 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6475c269-af20-400d-85fb-bf54b3f05ca2 req-309521d6-8af6-41db-a2a0-2007d12f035c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0844381 May 25 15:43:32.021453 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6475c269-af20-400d-85fb-bf54b3f05ca2 req-828ac622-1719-46b8-a508-1ac1bfa77040 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412445 May 25 15:43:32.029956 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60e0eb7-0946-4803-9174-4ea68350c635 req-f8c0e162-2ee4-47f8-b6cf-5dc772ad1a00 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:32.031435 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c60e0eb7-0946-4803-9174-4ea68350c635 req-f8c0e162-2ee4-47f8-b6cf-5dc772ad1a00 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0818236 May 25 15:43:32.079335 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c60e0eb7-0946-4803-9174-4ea68350c635 req-45748edb-34f9-4124-a53b-8724ea4916ab tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419233 May 25 15:43:32.281713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa req-dd289a98-f3e9-4a32-929c-9a765d8f0262 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:32.283179 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa req-dd289a98-f3e9-4a32-929c-9a765d8f0262 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0848806 May 25 15:43:32.329091 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-32f9da1a-bbd4-4566-bb12-3bfe4fa7a3aa req-2d3154f1-e2e8-42c2-878f-da8ebbfbca91 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400977 May 25 15:43:32.500079 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04878715-42af-4673-9077-d666b4493d2a req-77411a7e-dfae-4dce-95e2-a0acc6dde06d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:32.501543 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-04878715-42af-4673-9077-d666b4493d2a req-77411a7e-dfae-4dce-95e2-a0acc6dde06d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0846584 May 25 15:43:32.550386 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-04878715-42af-4673-9077-d666b4493d2a req-94f33778-d79d-454d-97fe-d324d9124a66 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0417542 May 25 15:43:32.619975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:32.664993 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-482bb238-ac15-469d-bb14-5dbaa7ccc370 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:33.025531 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afebc46-98a8-4c43-91d9-f478fab0559f req-8126d1f6-5b3a-402d-a88c-c4f9a2a1fea1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.027034 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1afebc46-98a8-4c43-91d9-f478fab0559f req-8126d1f6-5b3a-402d-a88c-c4f9a2a1fea1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0817311 May 25 15:43:33.078626 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1afebc46-98a8-4c43-91d9-f478fab0559f req-b2fe912d-1df4-49cf-976e-60f5b3f65ee1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449564 May 25 15:43:33.214523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5013b27-0ad2-4478-9708-0b62a4b41742 req-5e5f974f-4aac-4714-82e4-4c0079ed066c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.216060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b5013b27-0ad2-4478-9708-0b62a4b41742 req-5e5f974f-4aac-4714-82e4-4c0079ed066c tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0883160 May 25 15:43:33.263952 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b5013b27-0ad2-4478-9708-0b62a4b41742 req-a450d7cb-4651-4639-afad-f754ef0cf202 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419176 May 25 15:43:33.296113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decf501e-b38c-45f5-9d71-87329fe49a9c req-5ef9e8e5-d4a6-41e1-94c1-3d4493b1b352 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.297648 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-decf501e-b38c-45f5-9d71-87329fe49a9c req-5ef9e8e5-d4a6-41e1-94c1-3d4493b1b352 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1010199 May 25 15:43:33.343900 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-decf501e-b38c-45f5-9d71-87329fe49a9c req-21b046cc-08d7-4ea8-8538-a8b295f06c18 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404558 May 25 15:43:33.433547 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:33.528566 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-decd89ec-b36d-418f-94cc-8f79439d3f51 req-2a1cd288-437d-426c-b00f-9379ae3b7495 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.530029 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-decd89ec-b36d-418f-94cc-8f79439d3f51 req-2a1cd288-437d-426c-b00f-9379ae3b7495 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0836623 May 25 15:43:33.575486 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-decd89ec-b36d-418f-94cc-8f79439d3f51 req-a9776c60-8883-4576-a934-051dca67af86 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392492 May 25 15:43:33.752424 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 req-9285740c-0167-431b-bf8b-c4919d05341a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:33.753946 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 req-9285740c-0167-431b-bf8b-c4919d05341a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0891354 May 25 15:43:33.802628 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8a5be130-79c1-45ed-8cba-3ff9989de9a1 req-716e31e3-26e6-4421-9775-81b80b4cfd0c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0417855 May 25 15:43:34.274347 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4494ad32-3c99-4802-9006-984738d63c95 req-699697c5-cd19-4e71-ba78-3eacefc164a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.275890 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4494ad32-3c99-4802-9006-984738d63c95 req-699697c5-cd19-4e71-ba78-3eacefc164a4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0836194 May 25 15:43:34.326209 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4494ad32-3c99-4802-9006-984738d63c95 req-d6c8528d-d568-429b-8f4d-448ee1b01d07 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447793 May 25 15:43:34.456960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-667d9274-f411-424b-91a7-64b803ec5979 req-e1c4ee48-7c27-41a7-a1a3-60c8bd038878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.458440 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-667d9274-f411-424b-91a7-64b803ec5979 req-e1c4ee48-7c27-41a7-a1a3-60c8bd038878 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0842319 May 25 15:43:34.502658 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-667d9274-f411-424b-91a7-64b803ec5979 req-e23e868d-3dff-44fa-a90c-fdb0eb6b8d4a tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387125 May 25 15:43:34.537915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e4d859a-8525-4ab2-929d-fba4b87d788c req-e5cbcd37-e417-472a-ba06-6dda9555db5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.539377 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6e4d859a-8525-4ab2-929d-fba4b87d788c req-e5cbcd37-e417-472a-ba06-6dda9555db5d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0825491 May 25 15:43:34.583613 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6e4d859a-8525-4ab2-929d-fba4b87d788c req-cf3c6324-f1cb-4bbe-89ae-9d4883c264e7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386655 May 25 15:43:34.826086 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40fce301-b751-4ed6-af2f-d37f83a91a25 req-5aa2ab91-10f8-4330-9ae9-2feb78e2bf65 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.827637 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-40fce301-b751-4ed6-af2f-d37f83a91a25 req-5aa2ab91-10f8-4330-9ae9-2feb78e2bf65 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.1411543 May 25 15:43:34.872394 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-40fce301-b751-4ed6-af2f-d37f83a91a25 req-a7f53f62-1ae8-4647-8d53-197a0e3482ef tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391545 May 25 15:43:34.994426 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbd98ed3-8077-4182-9654-15f8acdf91d9 req-ee4e55e7-e6c8-4be0-89db-7a177dc2ebc8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:34.995937 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dbd98ed3-8077-4182-9654-15f8acdf91d9 req-ee4e55e7-e6c8-4be0-89db-7a177dc2ebc8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0837488 May 25 15:43:35.053567 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dbd98ed3-8077-4182-9654-15f8acdf91d9 req-ba7b5594-4764-43bf-a5e0-95870589f97c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0466928 May 25 15:43:35.150688 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-3d77344f-1c09-4eeb-b19d-f2b9bb7a33ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.151432 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-3d77344f-1c09-4eeb-b19d-f2b9bb7a33ee service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1137 time: 0.0709214 May 25 15:43:35.156682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:35.295671 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-c673fd03-b177-4579-8916-3442ad4bfb6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.297182 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-c673fd03-b177-4579-8916-3442ad4bfb6b service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.1327777 May 25 15:43:35.413542 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-eaccc4b2-a24d-4b32-a04a-35437d370150 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 1000 time: 0.0967104 May 25 15:43:35.488985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-8d5b9206-96a3-41c8-bfa7-ec5f7abe0144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.490421 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-8d5b9206-96a3-41c8-bfa7-ec5f7abe0144 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0612595 May 25 15:43:35.515203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4611ae09-b980-4e71-85bc-bae297b24043 req-9348623f-7d78-411a-9e69-96210dbf6b96 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.516677 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4611ae09-b980-4e71-85bc-bae297b24043 req-9348623f-7d78-411a-9e69-96210dbf6b96 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0774808 May 25 15:43:35.564047 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4611ae09-b980-4e71-85bc-bae297b24043 req-cabafd38-a7a8-4a3a-a440-f52298cb7f92 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416658 May 25 15:43:35.575848 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-c34bfc27-4b6b-495e-882a-266e7a0743e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.577467 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-c34bfc27-4b6b-495e-882a-266e7a0743e7 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0753522 May 25 15:43:35.778933 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-4ace9edf-b773-4317-bbb0-032e9839c74c service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1867845 May 25 15:43:35.781900 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 req-728c4752-9970-443f-9b92-337bbf8807ee tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.783361 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 req-728c4752-9970-443f-9b92-337bbf8807ee tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0837111 May 25 15:43:35.794678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff240585-8c2b-4d0b-862c-90ded909458a req-9206089d-9abe-4b6d-ae97-2c1edb574981 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:35.796120 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff240585-8c2b-4d0b-862c-90ded909458a req-9206089d-9abe-4b6d-ae97-2c1edb574981 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.1334035 May 25 15:43:35.829868 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-53b6a6a9-41bb-47b6-85d8-bd45d9312a61 req-fad1598f-3f7a-4c6e-95f0-5c98039d711b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402145 May 25 15:43:36.003149 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff240585-8c2b-4d0b-862c-90ded909458a req-fe0c8535-c143-4e39-b055-667376333e29 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1164176 May 25 15:43:36.025229 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-000b49b8-1e6e-4d42-bbb4-2e9b50d79b9b req-be22e02f-38fd-4826-92dc-de7f562d6e7e service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2281721 May 25 15:43:36.058092 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099c2507-7a2a-4727-a698-e41b11fca7ce req-c73afc09-a9b3-4379-be44-465f2b57aac4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:36.059579 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-099c2507-7a2a-4727-a698-e41b11fca7ce req-c73afc09-a9b3-4379-be44-465f2b57aac4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 943 time: 0.0828965 May 25 15:43:36.104342 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-099c2507-7a2a-4727-a698-e41b11fca7ce req-af2efc05-405c-48f5-bdba-0106c2af3f14 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388734 May 25 15:43:36.240961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1f07292-4672-4e0a-a78a-40462b438d1a req-55cf93ce-8321-4d87-952b-a4df6f706fc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:36.242454 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c1f07292-4672-4e0a-a78a-40462b438d1a req-55cf93ce-8321-4d87-952b-a4df6f706fc5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0810819 May 25 15:43:36.292485 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c1f07292-4672-4e0a-a78a-40462b438d1a req-58d3b570-6166-4cc5-9f29-8ccb15af8d37 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0439379 May 25 15:43:36.638039 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:43:36.755333 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2460ddf-aac0-49d3-8215-c2067cd85f67 req-7d95d421-f19f-4424-92dc-3f4cb0d49b89 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:36.756810 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b2460ddf-aac0-49d3-8215-c2067cd85f67 req-7d95d421-f19f-4424-92dc-3f4cb0d49b89 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0790052 May 25 15:43:36.770546 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:36.783413 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'port_id': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'mac_address': 'fa:16:3e:da:14:1a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:43:36.801308 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b2460ddf-aac0-49d3-8215-c2067cd85f67 req-4d8005aa-21fc-4969-b591-da2d3159acce tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385022 May 25 15:43:36.837908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:36.855805 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:36.871053 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:36.876415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:36.878557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:36.946656 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:36.949826 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:37.025837 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d4b29d-dfc9-4706-9321-74f510c22a8e req-497e6b7f-5a58-490d-98d1-fdeaf4bf710c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.027332 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-72d4b29d-dfc9-4706-9321-74f510c22a8e req-497e6b7f-5a58-490d-98d1-fdeaf4bf710c tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0849905 May 25 15:43:37.072897 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-72d4b29d-dfc9-4706-9321-74f510c22a8e req-be1902c3-f2cf-4670-9aea-860c051c849e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397751 May 25 15:43:37.194596 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf81356-c8f5-4ed5-bdee-193114a0c038 req-f7f7a77b-896f-4b8a-a419-d3d78a47a2f3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.196066 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0bf81356-c8f5-4ed5-bdee-193114a0c038 req-f7f7a77b-896f-4b8a-a419-d3d78a47a2f3 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0847378 May 25 15:43:37.243163 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0bf81356-c8f5-4ed5-bdee-193114a0c038 req-db922552-e17e-404d-b32c-eb67d1a240c9 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412979 May 25 15:43:37.295871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910c728c-c9a2-4431-8e71-96faf5cae576 req-6a77a7fd-5258-4574-9ecf-0fd1e1411bc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.297432 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-910c728c-c9a2-4431-8e71-96faf5cae576 req-6a77a7fd-5258-4574-9ecf-0fd1e1411bc9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 944 time: 0.0842249 May 25 15:43:37.343061 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-910c728c-c9a2-4431-8e71-96faf5cae576 req-8b222679-0bcd-4b10-a779-07c668376fd5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398893 May 25 15:43:37.373236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['746ae7a8-06cf-478c-b6d4-ecf4e9c02988'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:37.488952 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-461c635e-170d-4fd4-bfd0-52d6013bc71e req-f98898ca-3672-48f8-9920-6d623fc1c078 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.490750 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-461c635e-170d-4fd4-bfd0-52d6013bc71e req-f98898ca-3672-48f8-9920-6d623fc1c078 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.0742099 May 25 15:43:37.494612 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72348fa3-f80f-46f0-af3f-d67e64ed0478 req-96655b33-8479-4109-a92c-7a847ec5cd58 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.496216 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-72348fa3-f80f-46f0-af3f-d67e64ed0478 req-96655b33-8479-4109-a92c-7a847ec5cd58 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0864258 May 25 15:43:37.548475 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-72348fa3-f80f-46f0-af3f-d67e64ed0478 req-67293912-a821-4a35-8a1d-268a466cea64 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0463352 May 25 15:43:37.551508 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-461c635e-170d-4fd4-bfd0-52d6013bc71e req-3db5aa33-2a03-4c98-8f98-18a473c3ea7b service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0368533 May 25 15:43:37.893354 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-bdf36c9c-efed-4cec-87ae-0f8530bcfef8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:37.894825 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-bdf36c9c-efed-4cec-87ae-0f8530bcfef8 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.0841334 May 25 15:43:38.089344 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1847ce96-53da-4c8c-a062-dbd930ee3681 req-5b909e79-1b0f-4abe-80ae-9d6aacd5e636 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.090726 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1847ce96-53da-4c8c-a062-dbd930ee3681 req-5b909e79-1b0f-4abe-80ae-9d6aacd5e636 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1568642 May 25 15:43:38.119644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Deleting port b85f42e2-6150-40d8-a0ac-30b059e7807b {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:43:38.120017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.218267 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1847ce96-53da-4c8c-a062-dbd930ee3681 req-e0f6dc42-0169-4cb3-a2f4-32e2422ecba9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1201737 May 25 15:43:38.260758 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 req-b77d60c0-8516-490e-a70f-68792abd094e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.262458 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 req-b77d60c0-8516-490e-a70f-68792abd094e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0814030 May 25 15:43:38.273486 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] For port b85f42e2-6150-40d8-a0ac-30b059e7807b, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b85f42e2-6150-40d8-a0ac-30b059e7807b,segment=NetworkSegment(7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402),segment_id=7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:38.273842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.309412 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e195dc1b-f57b-467e-bdc6-b82a26ea8e67 req-e5482bdc-426c-414a-9b99-641adef6b4b1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410833 May 25 15:43:38.408920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Calling delete_port for b85f42e2-6150-40d8-a0ac-30b059e7807b owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:43:38.516205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 req-be9aecad-dd79-4b61-aab8-865ddad18446 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.517660 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 req-be9aecad-dd79-4b61-aab8-865ddad18446 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 945 time: 0.1156752 May 25 15:43:38.534056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2109e62d-6503-4e94-bc1f-62174216f08b req-569a3ff8-16cf-4c59-8d3a-b9ad7189cbac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.536146 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2109e62d-6503-4e94-bc1f-62174216f08b req-569a3ff8-16cf-4c59-8d3a-b9ad7189cbac tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 944 time: 0.0854211 May 25 15:43:38.580373 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2109e62d-6503-4e94-bc1f-62174216f08b req-5f471b75-8e2a-4f43-bb35-f37fc59f1b20 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382967 May 25 15:43:38.620962 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fafd2db8-8e63-4d00-ab2d-ae467284e6e7 req-35d841fd-b847-4080-9f89-f2f10d813968 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337b9c8-3c18-4807-9e19-356be0c8c6e9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953109 May 25 15:43:38.628814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.636728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:38.649560 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['b85f42e2-6150-40d8-a0ac-30b059e7807b'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:38.680847 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Pushing event deleted for resources: {'Port': ['ID=b85f42e2-6150-40d8-a0ac-30b059e7807b,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:38.683767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:38.697965 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:43:38.757812 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] No DVR routers for this DVR port b85f42e2-6150-40d8-a0ac-30b059e7807b on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:43:38.760411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.763287 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'name': 'network-vif-deleted', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:38.776704 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:43:38.782567 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a97b21c3-55ba-4148-9b44-b1295da0ac51 req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.70 "DELETE /v2.0/ports/b85f42e2-6150-40d8-a0ac-30b059e7807b HTTP/1.1" status: 204 len: 173 time: 0.8775301 May 25 15:43:38.787453 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:38.788078 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.819969 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '79e4fd0b-1392-4753-92e7-bab6790baa22', 'name': 'network-vif-deleted', 'tag': 'b85f42e2-6150-40d8-a0ac-30b059e7807b', 'status': 'completed', 'code': 200} May 25 15:43:38.830510 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a8d4261-6a3a-4362-ab01-01134deac2bd req-3a353a8b-8b68-48ef-9277-8a284b4fe4d8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:38.844082 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4a8d4261-6a3a-4362-ab01-01134deac2bd req-3a353a8b-8b68-48ef-9277-8a284b4fe4d8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1362669 May 25 15:43:38.900115 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4a8d4261-6a3a-4362-ab01-01134deac2bd req-a1308e45-1f6d-4c2f-a210-a861028c3410 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0550411 May 25 15:43:38.927854 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.958155 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:38.968245 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:38.972709 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:38.973888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b85f42e2-6150-40d8-a0ac-30b059e7807b no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:43:39.003741 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:39.042126 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'code': 200} May 25 15:43:39.055041 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: b85f42e2-6150-40d8-a0ac-30b059e7807b {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:43:39.055393 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b85f42e2-6150-40d8-a0ac-30b059e7807b not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:43:39.076697 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:39.079387 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:39.411748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aece8db-897a-45f6-980e-781260de756e req-21f40317-ce8e-4dc6-9567-fb6f4341c14a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.414074 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8aece8db-897a-45f6-980e-781260de756e req-21f40317-ce8e-4dc6-9567-fb6f4341c14a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1098 time: 0.0715294 May 25 15:43:39.423759 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-975236ed-482d-4684-b1e8-07537d67e03f req-dbb0b67c-5f4d-4c28-8612-9f5a5abc855e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.425782 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-975236ed-482d-4684-b1e8-07537d67e03f req-dbb0b67c-5f4d-4c28-8612-9f5a5abc855e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0940328 May 25 15:43:39.471011 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-975236ed-482d-4684-b1e8-07537d67e03f req-0e1ab871-8d3c-4ac6-8437-3d03f5fba86b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394623 May 25 15:43:39.586824 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8aece8db-897a-45f6-980e-781260de756e req-05a972a6-e139-460d-9469-770ae65b9652 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493927 May 25 15:43:39.610258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20f593ad-d816-4aeb-86d5-b59f5e66d42b req-cc2ae6a7-32b3-4e73-826b-d64c352bf3cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.611535 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-20f593ad-d816-4aeb-86d5-b59f5e66d42b req-cc2ae6a7-32b3-4e73-826b-d64c352bf3cc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1882036 May 25 15:43:39.660681 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-20f593ad-d816-4aeb-86d5-b59f5e66d42b req-21a7f91c-c55f-428b-869f-520310d1ba16 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429056 May 25 15:43:39.842789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-f31f6ad2-03cd-4017-b91e-a717b63072ed req-efd6e2ce-0c72-4d95-a6ef-3f7fdbdc89ec tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Synchronizing usage tracker for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:39.858940 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-f31f6ad2-03cd-4017-b91e-a717b63072ed req-efd6e2ce-0c72-4d95-a6ef-3f7fdbdc89ec tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Unset dirty status for tenant:b4d6b8a11a0d4e2c97f55bde6cd2c234 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:39.860281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f31f6ad2-03cd-4017-b91e-a717b63072ed req-efd6e2ce-0c72-4d95-a6ef-3f7fdbdc89ec tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] 10.222.0.36 "GET /v2.0/ports?device_id=79e4fd0b-1392-4753-92e7-bab6790baa22 HTTP/1.1" status: 200 len: 210 time: 0.0629139 May 25 15:43:39.919886 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 req-24a850ad-5126-46e5-a0ec-aee93be730c3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:39.921513 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 req-24a850ad-5126-46e5-a0ec-aee93be730c3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0826919 May 25 15:43:39.967328 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5d430c61-3d3b-49b3-a54a-ae5eb4dc9bf2 req-eca2ef3b-04f5-4c67-8135-d63c2413d6b3 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398586 May 25 15:43:40.142041 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 req-b4d97a11-a1c5-4d08-ab64-dd19ebc5a8f5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.143515 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 req-b4d97a11-a1c5-4d08-ab64-dd19ebc5a8f5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0835345 May 25 15:43:40.191496 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b19cd585-5ab5-4d16-8397-d832c5c3d0d7 req-8062edc2-2686-40e3-850a-7875b0df3963 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0415356 May 25 15:43:40.402539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-65caa7af-11ce-49ca-9f00-da585d1214fe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.403966 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-65caa7af-11ce-49ca-9f00-da585d1214fe service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 1098 time: 0.1338124 May 25 15:43:40.413006 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9ab252-8f81-4645-b6ea-daa9f0433930 req-f6766f1a-6a76-4efe-95d2-a59ade3d81c2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.414339 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dc9ab252-8f81-4645-b6ea-daa9f0433930 req-f6766f1a-6a76-4efe-95d2-a59ade3d81c2 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1141627 May 25 15:43:40.539065 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dc9ab252-8f81-4645-b6ea-daa9f0433930 req-c319ddc3-050a-49e6-be9d-71193ce1310a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1048696 May 25 15:43:40.573950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-78eeed2b-c04f-4fe2-938d-5530edd0adae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.575404 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-78eeed2b-c04f-4fe2-938d-5530edd0adae service neutron] 10.222.0.70 "GET /v2.0/networks?id=db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 200 len: 920 time: 0.1584265 May 25 15:43:40.629915 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:40.656844 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-58a4bbd1-0083-447c-b185-2e339be7ea56 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 200 len: 217 time: 0.0649924 May 25 15:43:40.666033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8355e16-8f5d-4073-8708-9f3e1cd93715 req-0756cfe3-4082-416f-b1c2-40f2e66b7494 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.667515 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c8355e16-8f5d-4073-8708-9f3e1cd93715 req-0756cfe3-4082-416f-b1c2-40f2e66b7494 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0807056 May 25 15:43:40.714346 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c8355e16-8f5d-4073-8708-9f3e1cd93715 req-34be3130-4c75-46e3-bbff-5469a217d504 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411520 May 25 15:43:40.724850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-f77c7612-36f7-4c89-9639-0b88ee98cba9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:40.726305 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-f77c7612-36f7-4c89-9639-0b88ee98cba9 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 200 len: 859 time: 0.0570095 May 25 15:43:40.781550 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-18b3bdeb-8bc6-47ab-9c67-7339176afcd1 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=db198222-1495-44ec-99cd-cc38de1c71df&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0398743 May 25 15:43:40.921668 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-c22a5211-62bd-4ff1-8411-6dcd63c13f27 service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282096 May 25 15:43:41.083515 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8933df4a-a9bc-4326-8a41-b5bfc422b104 req-56bb84ae-4f8e-408a-9130-bd88e08b21bf service neutron] 10.222.0.70 "GET /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1511176 May 25 15:43:41.186739 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e776972b-4018-4ff2-b2e5-9000b0f4d633 req-bdb21e47-7037-4238-a92c-89c71226ca11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.188127 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e776972b-4018-4ff2-b2e5-9000b0f4d633 req-bdb21e47-7037-4238-a92c-89c71226ca11 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0916741 May 25 15:43:41.240313 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e776972b-4018-4ff2-b2e5-9000b0f4d633 req-48b6d80a-cfc8-4cca-a83f-50441aad35a9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451448 May 25 15:43:41.387975 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6688e970-4420-4ece-8e70-837eda33b32a req-313e8bd2-cadf-4dbb-b3fb-627d757e4b3f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.389447 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6688e970-4420-4ece-8e70-837eda33b32a req-313e8bd2-cadf-4dbb-b3fb-627d757e4b3f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0859783 May 25 15:43:41.437542 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6688e970-4420-4ece-8e70-837eda33b32a req-f6628085-e8f1-4e44-8bcf-edbe223919e4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0415866 May 25 15:43:41.727894 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513065ec-3ba6-4291-8aba-de29ee14e575 req-c6760dc7-9551-4a0a-9827-c7a49248d64d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.729946 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-513065ec-3ba6-4291-8aba-de29ee14e575 req-c6760dc7-9551-4a0a-9827-c7a49248d64d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0837235 May 25 15:43:41.789101 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-513065ec-3ba6-4291-8aba-de29ee14e575 req-b7207f91-fc96-4beb-bb55-088d6bd7348b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532329 May 25 15:43:41.932832 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162e1ef6-78ed-43fd-87de-ffbb67687bbb req-2d936aaf-7abc-479e-9f17-c7b389f45d32 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:41.933967 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-162e1ef6-78ed-43fd-87de-ffbb67687bbb req-2d936aaf-7abc-479e-9f17-c7b389f45d32 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0813775 May 25 15:43:41.982447 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-162e1ef6-78ed-43fd-87de-ffbb67687bbb req-81273a62-46cb-4b36-9056-de41577258c5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424356 May 25 15:43:42.421741 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aa31af3-74eb-47f3-af57-fba9166918c6 req-d1c4d2bf-aa96-481c-98bb-e2a29100fa2b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:42.423170 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0aa31af3-74eb-47f3-af57-fba9166918c6 req-d1c4d2bf-aa96-481c-98bb-e2a29100fa2b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0781662 May 25 15:43:42.465589 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0aa31af3-74eb-47f3-af57-fba9166918c6 req-034ae98c-6cd7-4103-9404-6de49b4496fd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0361750 May 25 15:43:42.632307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d51296ee-f03f-4680-9500-f4a155eeacc5 req-9247e312-cbcd-4c11-9790-34a822da3730 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:42.633803 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d51296ee-f03f-4680-9500-f4a155eeacc5 req-9247e312-cbcd-4c11-9790-34a822da3730 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0858667 May 25 15:43:42.656727 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdc2e3f6-314b-424d-85a3-888a67115f87 req-f0ff4a69-b6c6-448f-b40e-6963367f9413 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:42.658186 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cdc2e3f6-314b-424d-85a3-888a67115f87 req-f0ff4a69-b6c6-448f-b40e-6963367f9413 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0890019 May 25 15:43:42.681408 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d51296ee-f03f-4680-9500-f4a155eeacc5 req-12682774-c884-4426-928b-111e23e6ffe3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0413976 May 25 15:43:42.702912 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cdc2e3f6-314b-424d-85a3-888a67115f87 req-433fc3ef-f83d-4630-b56a-4bfaebca084a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382292 May 25 15:43:42.726798 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 45302) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:42.837881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-558409a4-5ace-41f5-9268-d61527d48154 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:42.838587 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-558409a4-5ace-41f5-9268-d61527d48154 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] Synchronizing usage tracker for tenant:dd417f7ce220428a8ac4019081a23f62 on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:43:42.856202 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-558409a4-5ace-41f5-9268-d61527d48154 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] Unset dirty status for tenant:dd417f7ce220428a8ac4019081a23f62 on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:43:42.860149 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-558409a4-5ace-41f5-9268-d61527d48154 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1093 time: 0.1295407 May 25 15:43:42.860551 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 45310) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:43:42.865634 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'port_id': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address': '172.20.0.6'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:43:42.871285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:43:42.875423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:floatingip and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:43:42.878200 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:43:42.883881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:43:42.895530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:42.986619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed req-7124b215-b454-41ab-9c7b-0999eeac154b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:42.988193 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed req-7124b215-b454-41ab-9c7b-0999eeac154b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0860617 May 25 15:43:43.032695 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bb572bcf-0c6e-4e7a-a6a4-0ba8bec6d0ed req-1a26d175-e57f-4f54-a3bc-db75668fe807 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389280 May 25 15:43:43.134875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:43.289969 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dcd23d0-f615-453d-bf89-546c2b11c381 req-08d30e0e-3122-4465-a3a8-f56a63e14ead tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:43.291431 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8dcd23d0-f615-453d-bf89-546c2b11c381 req-08d30e0e-3122-4465-a3a8-f56a63e14ead tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1915693 May 25 15:43:43.326802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.27.0.111 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/90e5e0be-ef04-40ef-92cb-04a7a801dcdf) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:43:43.358071 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8dcd23d0-f615-453d-bf89-546c2b11c381 req-c900015a-18ba-4e2b-9e6d-7b44107bf5de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0581119 May 25 15:43:43.491350 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:43.521267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:43.525465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:43.587824 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:43:43.590294 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:43:43.593800 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:43:43.625952 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=90e5e0be-ef04-40ef-92cb-04a7a801dcdf,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:43.641992 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.642359 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.642719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.643072 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.643422 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.643816 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.644190 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.644538 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.644888 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.645232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.645575 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.645916 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:43:43.650552 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:43.870596 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 req-c913c774-fda8-45f1-9b67-ac7607e1c460 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:43.872089 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 req-c913c774-fda8-45f1-9b67-ac7607e1c460 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0854783 May 25 15:43:43.919501 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-210cdc79-0150-4dde-8ebe-cfdcf8e40bf5 req-e8fbf047-87dd-4ba4-821f-2b1fa34437a9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0416672 May 25 15:43:44.056536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:44.133290 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:44.342214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e req-bc8afc08-34a4-48e6-9615-a7097246b234 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:44.343660 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e req-bc8afc08-34a4-48e6-9615-a7097246b234 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1847792 May 25 15:43:44.416015 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7b441e8a-a6ad-4dc9-9554-ca23eb80208e req-2f93593b-b32b-4902-be1b-118b993a16a4 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618882 May 25 15:43:44.439066 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:44.444673 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:44.449575 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:44.555465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=90e5e0be-ef04-40ef-92cb-04a7a801dcdf,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:44.555737 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e79820-44b0-49c8-92b8-e69d58146155 req-73930b44-a9da-4357-8452-0a41f9e22b17 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:44.556968 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f4e79820-44b0-49c8-92b8-e69d58146155 req-73930b44-a9da-4357-8452-0a41f9e22b17 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0850792 May 25 15:43:44.559642 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:44.564212 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:44.604335 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f4e79820-44b0-49c8-92b8-e69d58146155 req-7e558bd2-4570-4328-a21c-16638cdc4783 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407376 May 25 15:43:44.810349 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4 associated. External IP: 172.27.0.111, port: 746ae7a8-06cf-478c-b6d4-ecf4e9c02988. May 25 15:43:45.218103 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c07afe-e518-4e7c-a1e5-7662c661babf req-ef22f0c0-5651-41ba-9906-4613fe1fa536 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:45.219541 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a9c07afe-e518-4e7c-a1e5-7662c661babf req-ef22f0c0-5651-41ba-9906-4613fe1fa536 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1811619 May 25 15:43:45.224194 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:43:45.342356 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a9c07afe-e518-4e7c-a1e5-7662c661babf req-2d17c1bc-af5a-4c17-b3c4-fbf98629a69d tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1155508 May 25 15:43:45.440507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:43:45.451192 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:43:45.462166 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:43:45.462858 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:43:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:43:45.465118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:45.522977 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6613967 May 25 15:43:45.524159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:45.583547 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'status': 'completed', 'code': 200} May 25 15:43:45.605267 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 req-4d7c7f99-e9cf-4ed7-bec2-e70cd3406341 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:45.606736 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 req-4d7c7f99-e9cf-4ed7-bec2-e70cd3406341 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0838642 May 25 15:43:45.640841 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:43:45.655408 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bab7fb31-1b9c-4c8c-b384-0bc06ba014b4 req-db119561-f826-4c75-bdc1-dd9fd274c36a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429852 May 25 15:43:45.801571 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88af54b6-6bfb-4b29-b4dd-96df72f22606 req-cb169166-dba9-48b9-9f3d-c5b91555003b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:45.803070 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-88af54b6-6bfb-4b29-b4dd-96df72f22606 req-cb169166-dba9-48b9-9f3d-c5b91555003b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0833735 May 25 15:43:45.849704 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-88af54b6-6bfb-4b29-b4dd-96df72f22606 req-992a0516-c17a-4734-aab0-c402832e1574 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409100 May 25 15:43:46.012552 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.111', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 431, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:da:14:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:43:43Z', 'updated_at': '2021-05-25T15:43:43Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:43:46.016292 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:43:46.024746 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:43:46.025335 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:43:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:43:46.197915 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:43:46.554694 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.111', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 431, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:da:14:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:43:43Z', 'updated_at': '2021-05-25T15:43:43Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:43:46.558747 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b1b5ed3d-bbe6-4702-8b0a-4c574d9c1171 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.111', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 431, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:da:14:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:43:43Z', 'updated_at': '2021-05-25T15:43:43Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:43:46.606338 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 req-ef8b4da2-e486-477b-ae53-2f9051bc8a56 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:46.607823 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 req-ef8b4da2-e486-477b-ae53-2f9051bc8a56 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1503735 May 25 15:43:46.656046 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-db07aa59-2a77-48ab-9568-fb3f098eb3b1 req-01a9f4a6-666c-47e1-92d4-af6b89c609b5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0417974 May 25 15:43:46.764331 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b9296804-2a5d-40a0-8b0b-b61ebe689ce0 None None] New status for floating IP fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4: ACTIVE {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:43:46.856849 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9de912c3-d3fc-4d28-b59b-ccf2b64145af req-7600af99-fb46-42c4-b799-1a5cf0b6f827 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:46.858330 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9de912c3-d3fc-4d28-b59b-ccf2b64145af req-7600af99-fb46-42c4-b799-1a5cf0b6f827 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0894051 May 25 15:43:46.861538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-ff0cc830-d155-49bc-93e2-4a0f1082822f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:46.863604 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-ff0cc830-d155-49bc-93e2-4a0f1082822f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1098 time: 0.0727422 May 25 15:43:46.910766 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9de912c3-d3fc-4d28-b59b-ccf2b64145af req-1d64bd35-b99e-4a8f-88b8-9a44ed70db1f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462086 May 25 15:43:47.055605 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-872defe9-05ca-4656-a10f-8f673af6dadd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.057175 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-872defe9-05ca-4656-a10f-8f673af6dadd service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1836357 May 25 15:43:47.129883 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 req-024a0aaf-262c-43f8-b33f-f25d3b3f2c9e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.131312 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 req-024a0aaf-262c-43f8-b33f-f25d3b3f2c9e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.1627369 May 25 15:43:47.204097 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b85f3bca-4d3b-4ca8-8f70-c636808ac3c1 req-adb0e37a-ee7e-4f6b-905f-8b8468a42423 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666957 May 25 15:43:47.209620 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-100762a2-9b0f-46e5-9939-f687c29aadc1 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 200 len: 1001 time: 0.1371686 May 25 15:43:47.280374 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-165e1ae3-dc16-4cf7-b64f-f23ee598b53c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.281823 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-165e1ae3-dc16-4cf7-b64f-f23ee598b53c service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0609665 May 25 15:43:47.375039 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-fce04246-eb4c-4079-9a4d-98933323f288 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.376435 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-fce04246-eb4c-4079-9a4d-98933323f288 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0693297 May 25 15:43:47.515210 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-743a8735-c993-4d27-899c-2f5ab6436c7f service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1227365 May 25 15:43:47.649119 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4bca0f34-b88f-4be6-9946-01beb55a29d3 req-7fea021d-964e-46cd-961d-e73664df7201 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1220369 May 25 15:43:47.676463 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:43:47.847404 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27072df7-72a8-441b-a41b-62c23afb2384 req-93a2de71-4335-4262-b15a-4b26d2bbe86a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:47.850500 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-27072df7-72a8-441b-a41b-62c23afb2384 req-93a2de71-4335-4262-b15a-4b26d2bbe86a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0863137 May 25 15:43:47.900871 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-27072df7-72a8-441b-a41b-62c23afb2384 req-9fe73993-0c7c-449d-b072-019573df1d0b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0441334 May 25 15:43:48.106436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff64090-5b96-43ce-9da4-cc3a6a180450 req-e132f9b4-3916-43da-aa2f-6b32d5ba178a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:48.108035 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fff64090-5b96-43ce-9da4-cc3a6a180450 req-e132f9b4-3916-43da-aa2f-6b32d5ba178a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0869823 May 25 15:43:48.153596 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fff64090-5b96-43ce-9da4-cc3a6a180450 req-33a23b16-8207-4e3b-98c2-eba73b6aa7ad tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393391 May 25 15:43:48.419693 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 req-01e2b867-d8a6-4e8d-bed2-2c1c5c1c9e41 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:48.421113 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 req-01e2b867-d8a6-4e8d-bed2-2c1c5c1c9e41 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 944 time: 0.0860977 May 25 15:43:48.482095 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-33448180-d5e0-4f9c-bdc6-f3c7e612de26 req-58db818d-75b5-44fd-80b6-842699f67ddc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545442 May 25 15:43:48.663144 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:43:48.829229 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:48.843699 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'mac_address': 'fa:16:3e:c2:e5:5e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:43:48.898435 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:48.920248 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:43:48.937706 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:48.942730 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:48.945048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:49.058977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=9']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:49.062929 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:49.153357 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 req-132dc9fb-51da-49d3-8921-b11e4fb5bdf3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:49.154840 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 req-132dc9fb-51da-49d3-8921-b11e4fb5bdf3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0977983 May 25 15:43:49.204967 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b91560b-cc1d-4ca6-a588-0743e6f671d0 req-bbf01f04-986e-4f85-8ff3-00d8c8dcc5f5 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0424917 May 25 15:43:49.370324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef87952a-028f-404f-9e45-49e4b82a9f5a req-eee9dcbb-af93-4334-b12e-f3521d6ef4f1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:49.371785 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ef87952a-028f-404f-9e45-49e4b82a9f5a req-eee9dcbb-af93-4334-b12e-f3521d6ef4f1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0838048 May 25 15:43:49.416901 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ef87952a-028f-404f-9e45-49e4b82a9f5a req-ac85cf4c-0f9f-45be-bc7a-5c0e92a96bdd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394871 May 25 15:43:49.488572 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['3f734a1c-be04-4203-b351-6b0b6785f9ae'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:43:49.755035 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 req-4414ecfb-a4b5-4023-933c-190c4d31a73a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:49.757392 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 req-4414ecfb-a4b5-4023-933c-190c4d31a73a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.1395829 May 25 15:43:49.823985 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cfb0e5a7-0d20-4ae7-aed4-0dd0aaa88685 req-d5c4ec41-3dd9-4c4f-b9e8-be127ba3e2fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0587509 May 25 15:43:50.404644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa93d354-7e4b-479c-ae33-923a218ba720 req-604edb47-f33b-48f9-b4e5-ecefe08af50a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:50.406889 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa93d354-7e4b-479c-ae33-923a218ba720 req-604edb47-f33b-48f9-b4e5-ecefe08af50a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0849035 May 25 15:43:50.466811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa93d354-7e4b-479c-ae33-923a218ba720 req-54755762-4031-49e5-aae1-7eb3b736f68f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0533803 May 25 15:43:51.134871 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 req-16c69ade-baeb-4f7b-82d1-0b0d01d96883 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:51.144721 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 req-16c69ade-baeb-4f7b-82d1-0b0d01d96883 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.1925833 May 25 15:43:51.199580 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a5183fc6-bd8c-4816-8da1-d98d3af49a45 req-fee26807-90cb-4266-90b6-b54abb98ab20 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538044 May 25 15:43:51.655569 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e68478e0-57d9-45b6-9c27-a33490669b46 req-ea8e7565-82a1-42e7-b3e4-1c8968427a7b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:51.657424 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e68478e0-57d9-45b6-9c27-a33490669b46 req-ea8e7565-82a1-42e7-b3e4-1c8968427a7b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0836582 May 25 15:43:51.728086 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e68478e0-57d9-45b6-9c27-a33490669b46 req-c432e244-6d14-44dc-bcf5-bc32db693f73 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0589542 May 25 15:43:52.466057 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5776fa93-91dd-49a3-bef7-cbee38c979e0 req-35c574c2-9fed-4afc-9a35-128153651342 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:52.475118 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5776fa93-91dd-49a3-bef7-cbee38c979e0 req-35c574c2-9fed-4afc-9a35-128153651342 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 945 time: 0.1165414 May 25 15:43:52.536431 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5776fa93-91dd-49a3-bef7-cbee38c979e0 req-6cef3866-3086-4f3e-a8e8-6c5b7da7ca8b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0601146 May 25 15:43:52.710059 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:43:52.780420 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 3f734a1c-be04-4203-b351-6b0b6785f9ae triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:43:52.780817 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:52.910790 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:52.941078 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:43:52.948020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d53be68-c595-49f0-b177-a6348ac03d7a req-5ecfd83a-9b02-422e-9d94-8e4d2c6efc49 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:52.949719 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4d53be68-c595-49f0-b177-a6348ac03d7a req-5ecfd83a-9b02-422e-9d94-8e4d2c6efc49 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1008494 May 25 15:43:52.959799 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:43:52.964379 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:43:52.967066 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:43:53.006732 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'code': 200} May 25 15:43:53.013703 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4d53be68-c595-49f0-b177-a6348ac03d7a req-ab968ceb-c351-4656-8540-5df16ee8196a tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0572767 May 25 15:43:53.048900 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=10']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:43:53.056766 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:43:53.782324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38aaca1f-1717-47db-9e64-7c630c0d5dae req-afae8403-9e26-41e4-9d3a-c3b29e5f9c7c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.789214 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38aaca1f-1717-47db-9e64-7c630c0d5dae req-afae8403-9e26-41e4-9d3a-c3b29e5f9c7c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.0955598 May 25 15:43:53.840577 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-38aaca1f-1717-47db-9e64-7c630c0d5dae req-d1c73b8a-5e12-4696-814a-033459cd729a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504575 May 25 15:43:53.917826 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0e0c47a-99e2-4230-9c94-c24824b11e08 req-4b82f502-38a0-476e-a71f-7e05cb82cc21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:53.919317 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c0e0c47a-99e2-4230-9c94-c24824b11e08 req-4b82f502-38a0-476e-a71f-7e05cb82cc21 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1100 time: 0.0777445 May 25 15:43:53.970786 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c0e0c47a-99e2-4230-9c94-c24824b11e08 req-3027ddf4-86ac-413b-a9af-c92fa3b91791 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400922 May 25 15:43:54.305091 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 req-44c1ed0f-3c54-4057-a413-64610eb9fca7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:54.306566 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 req-44c1ed0f-3c54-4057-a413-64610eb9fca7 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1729383 May 25 15:43:54.356286 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cda2769a-a4c4-4074-bf2c-a7cc92cf2f88 req-96b4c9ad-0d26-46fa-aa9f-632eec9a9254 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0428722 May 25 15:43:55.098551 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ebb07e3-61e8-4bd6-835c-f9b87626043c req-bc6dcc46-414e-45e2-a510-3ba4b58fd692 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:55.100905 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2ebb07e3-61e8-4bd6-835c-f9b87626043c req-bc6dcc46-414e-45e2-a510-3ba4b58fd692 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.1427827 May 25 15:43:55.163556 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2ebb07e3-61e8-4bd6-835c-f9b87626043c req-b56e0145-7f4d-41df-a1f9-174efa74964b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559444 May 25 15:43:55.430848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c588714a-12ce-4ee3-b012-7268c87f524d req-592ad4ac-fa79-4cbc-a17e-24ebdf898d1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:55.432416 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c588714a-12ce-4ee3-b012-7268c87f524d req-592ad4ac-fa79-4cbc-a17e-24ebdf898d1d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.0867925 May 25 15:43:55.480650 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c588714a-12ce-4ee3-b012-7268c87f524d req-0a5cbf4d-2c00-4599-b3f6-08f2668162c5 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422976 May 25 15:43:55.557950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e58323-7192-4222-a49a-69a62bdf1a1b req-cd0c95d3-6bff-462c-87a0-d3c4eb5be777 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:55.559442 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-73e58323-7192-4222-a49a-69a62bdf1a1b req-cd0c95d3-6bff-462c-87a0-d3c4eb5be777 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0843077 May 25 15:43:55.611745 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-73e58323-7192-4222-a49a-69a62bdf1a1b req-96b34387-fca1-4e43-9758-24a13bbed84c tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0462089 May 25 15:43:56.413024 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479b473e-1229-445e-803b-f2f1eb7bc7d3 req-28763734-10d5-483a-a56a-8011c111f799 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:56.414499 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-479b473e-1229-445e-803b-f2f1eb7bc7d3 req-28763734-10d5-483a-a56a-8011c111f799 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.1129947 May 25 15:43:56.462986 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-479b473e-1229-445e-803b-f2f1eb7bc7d3 req-0a7cb6cf-6111-4820-8fb2-d4529d72a0a5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422032 May 25 15:43:56.746068 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 req-6c1b1e1c-c89c-427b-8bf0-60ee504e7370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:56.751343 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 req-6c1b1e1c-c89c-427b-8bf0-60ee504e7370 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1491039 May 25 15:43:56.830833 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-afdd26e1-c4cb-40d7-89a1-59d5b1b47333 req-f18df1cc-e9b5-4102-a3e5-4b27ab8f8c98 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0722036 May 25 15:43:56.900429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6a5e54b-681e-4543-a252-24e20fed1533 req-f024eb71-1707-486b-aeab-790a5b123a44 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:56.901995 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f6a5e54b-681e-4543-a252-24e20fed1533 req-f024eb71-1707-486b-aeab-790a5b123a44 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1006730 May 25 15:43:56.967740 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f6a5e54b-681e-4543-a252-24e20fed1533 req-a430b8c4-e8b1-4810-97fe-0e2d46d0cdda tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0596092 May 25 15:43:57.833293 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b6fedc-61b4-4453-ad92-dce353efcd64 req-826de8e8-e095-4183-98b7-a81e951085b5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:57.845815 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-80b6fedc-61b4-4453-ad92-dce353efcd64 req-826de8e8-e095-4183-98b7-a81e951085b5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.1141138 May 25 15:43:57.890182 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-80b6fedc-61b4-4453-ad92-dce353efcd64 req-d1f72c72-b622-4d45-972c-b6e791379837 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434556 May 25 15:43:58.047136 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cb92f4c-d3a6-4692-a430-07745db52a75 req-5f3cbaae-e93d-419d-9276-d58f58677779 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:58.050684 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4cb92f4c-d3a6-4692-a430-07745db52a75 req-5f3cbaae-e93d-419d-9276-d58f58677779 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1036818 May 25 15:43:58.105131 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4cb92f4c-d3a6-4692-a430-07745db52a75 req-42c34ea7-850e-456d-847f-f11b3fff8dbe tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482094 May 25 15:43:58.177834 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd7d62bc-fecc-4fb3-b843-90550e139c2f req-8b17d470-c3b4-497e-bfff-7e28cf5ef0c8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:58.179412 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bd7d62bc-fecc-4fb3-b843-90550e139c2f req-8b17d470-c3b4-497e-bfff-7e28cf5ef0c8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1001058 May 25 15:43:58.230001 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bd7d62bc-fecc-4fb3-b843-90550e139c2f req-43285700-0cce-4f0b-98a8-30078ebdb50f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0429742 May 25 15:43:59.329339 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 req-fbb4c8c7-baa1-45e0-b6fb-8737e2c2bc15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:59.334254 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 req-fbb4c8c7-baa1-45e0-b6fb-8737e2c2bc15 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1094630 May 25 15:43:59.392325 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9da8abf6-5763-4805-9f9e-46c7671ea1a6 req-0d83e3ac-635e-4735-90db-4ed457df0d3f tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524886 May 25 15:43:59.457921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb267bbb-d347-475b-ae66-7c0e224f7458 req-d66cd062-e691-437f-8800-03d53589c0b0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:43:59.460065 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb267bbb-d347-475b-ae66-7c0e224f7458 req-d66cd062-e691-437f-8800-03d53589c0b0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1073616 May 25 15:43:59.510135 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb267bbb-d347-475b-ae66-7c0e224f7458 req-acc1029c-7d45-4ef6-914d-cd8c556bd513 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0427601 May 25 15:43:59.980315 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b77e2a53-1be3-4a9d-8047-b4289c8b1553 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:00.580309 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f8d952-e05c-4471-9226-10a679e844fc req-5cd623a1-71c3-401f-bf46-4abc69d0b150 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:00.582555 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-48f8d952-e05c-4471-9226-10a679e844fc req-5cd623a1-71c3-401f-bf46-4abc69d0b150 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.0896730 May 25 15:44:00.642262 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-48f8d952-e05c-4471-9226-10a679e844fc req-028c8b92-7e80-4d4b-a7ea-63ab7657dc8a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537384 May 25 15:44:00.738537 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30511015-7702-43f1-8ad4-7748e58ff726 req-c4f9620d-8ea7-42fc-a7f8-9d700daac6fd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:00.740321 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-30511015-7702-43f1-8ad4-7748e58ff726 req-c4f9620d-8ea7-42fc-a7f8-9d700daac6fd tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 946 time: 0.1436539 May 25 15:44:00.770473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a16cf48-7066-48e7-8c67-f95c415729b3 req-99a53487-f926-45bf-82f1-8049d19f03e0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:00.772101 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9a16cf48-7066-48e7-8c67-f95c415729b3 req-99a53487-f926-45bf-82f1-8049d19f03e0 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1112905 May 25 15:44:00.935912 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9a16cf48-7066-48e7-8c67-f95c415729b3 req-969978fc-ed2d-4a6a-97ab-e4eb0a85aff3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1071277 May 25 15:44:00.965115 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Deleting port 58598550-b0ed-4b7c-a4d8-2e58f345261c {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:44:00.965862 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.130885 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] For port 58598550-b0ed-4b7c-a4d8-2e58f345261c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=58598550-b0ed-4b7c-a4d8-2e58f345261c,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:01.131254 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.261963 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling delete_port for 58598550-b0ed-4b7c-a4d8-2e58f345261c owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:44:01.400506 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.407591 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:01.423958 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['58598550-b0ed-4b7c-a4d8-2e58f345261c', '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:44:01.473934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Pushing event deleted for resources: {'Port': ['ID=58598550-b0ed-4b7c-a4d8-2e58f345261c,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:01.489505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.490197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.490805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.491876 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.492001 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.492613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.492950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.493686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.494275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.494862 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.495207 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.495680 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:01.548432 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:01.618201 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] No DVR routers for this DVR port 58598550-b0ed-4b7c-a4d8-2e58f345261c on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:44:01.629379 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:01.632698 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'name': 'network-vif-deleted', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:44:01.652916 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-30511015-7702-43f1-8ad4-7748e58ff726 req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "DELETE /v2.0/ports/58598550-b0ed-4b7c-a4d8-2e58f345261c HTTP/1.1" status: 204 len: 173 time: 0.8909881 May 25 15:44:01.694554 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '80a5442b-0f3d-41d4-b44f-74e483852fda', 'name': 'network-vif-deleted', 'tag': '58598550-b0ed-4b7c-a4d8-2e58f345261c', 'status': 'completed', 'code': 200} May 25 15:44:01.819507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-5381f67a-a6fe-4d37-947e-6ab4238d6774 req-875f6a6b-8a74-4b45-a60f-9df8508cc898 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Synchronizing usage tracker for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:44:01.840913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-5381f67a-a6fe-4d37-947e-6ab4238d6774 req-875f6a6b-8a74-4b45-a60f-9df8508cc898 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Unset dirty status for tenant:0a695c168ea64d4f96c9e8751a6875ca on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:44:01.842556 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5381f67a-a6fe-4d37-947e-6ab4238d6774 req-875f6a6b-8a74-4b45-a60f-9df8508cc898 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=80a5442b-0f3d-41d4-b44f-74e483852fda HTTP/1.1" status: 200 len: 210 time: 0.0744131 May 25 15:44:02.135025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95456a88-150c-4b30-bda2-d8983af29115 req-21baad9a-e89f-4fbe-8685-d66b8dea2aec tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:02.136939 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-95456a88-150c-4b30-bda2-d8983af29115 req-21baad9a-e89f-4fbe-8685-d66b8dea2aec tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0909359 May 25 15:44:02.192784 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-95456a88-150c-4b30-bda2-d8983af29115 req-2eb4efbe-cdf5-4834-a954-f6529b4cc362 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0496583 May 25 15:44:02.624767 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:02.668459 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f69c97dd-a726-4c2f-8366-28266f633a00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.395313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95d183f-dbf1-443d-b774-a26ae3364fc9 req-4d4bd4b4-bcd2-4c5f-8c61-51be0de34efc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:03.396978 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b95d183f-dbf1-443d-b774-a26ae3364fc9 req-4d4bd4b4-bcd2-4c5f-8c61-51be0de34efc tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0988126 May 25 15:44:03.427291 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c56455df-4183-465d-b308-a3d50e851a05 req-6978c601-e44d-4f20-8a8d-d29738e3a4a9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:03.437622 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c56455df-4183-465d-b308-a3d50e851a05 req-6978c601-e44d-4f20-8a8d-d29738e3a4a9 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.1072974 May 25 15:44:03.438566 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:03.449755 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b95d183f-dbf1-443d-b774-a26ae3364fc9 req-bcc816c7-a3d8-42ae-aadc-4680b1d6ba0e tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465739 May 25 15:44:03.492113 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c56455df-4183-465d-b308-a3d50e851a05 req-dff62f58-465c-48c0-97df-2c7dfbc23c9b tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&id=17501c6a-8302-4871-b31d-a8c482336d39&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0535607 May 25 15:44:04.670496 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f req-25a4b225-7b78-461a-8bf6-62f8bc2e86e0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:04.672891 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f req-25a4b225-7b78-461a-8bf6-62f8bc2e86e0 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1013100 May 25 15:44:04.730088 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7fe7c5cf-0cde-4393-b92a-fdbdef31dc7f req-129e01ce-3282-47ee-af0f-a4832474de06 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509374 May 25 15:44:04.760434 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 58598550-b0ed-4b7c-a4d8-2e58f345261c no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:44:04.820778 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 58598550-b0ed-4b7c-a4d8-2e58f345261c {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:44:04.821136 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 58598550-b0ed-4b7c-a4d8-2e58f345261c not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:44:05.156821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:05.950581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb req-b7be619e-492b-47b1-b1b5-c0231f8d5d70 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:05.952175 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb req-b7be619e-492b-47b1-b1b5-c0231f8d5d70 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0856748 May 25 15:44:06.000552 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d14911ef-f0c2-4cd1-ab73-40c7be0c2acb req-44ee03a9-cd2e-4dac-b519-7747e90ab35b tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398574 May 25 15:44:07.292886 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe3753a-070f-4a46-a43d-c76cb34eedaa req-73ff1c7c-b383-45ea-9d3d-e150095da9a9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:07.294856 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cbe3753a-070f-4a46-a43d-c76cb34eedaa req-73ff1c7c-b383-45ea-9d3d-e150095da9a9 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1795998 May 25 15:44:07.352591 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cbe3753a-070f-4a46-a43d-c76cb34eedaa req-b7ea6d86-b0da-4a79-aea2-6c9920e52644 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511627 May 25 15:44:08.548797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8378cf8-b242-419e-be81-fac8857b9976 req-376b148a-cca7-4bb0-bf43-11711dc8af02 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:08.550837 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d8378cf8-b242-419e-be81-fac8857b9976 req-376b148a-cca7-4bb0-bf43-11711dc8af02 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0837808 May 25 15:44:08.601460 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d8378cf8-b242-419e-be81-fac8857b9976 req-8e259edd-984a-4749-a18e-1e9bb0a7f524 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441313 May 25 15:44:08.905808 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-c672faca-c0aa-4c5d-b907-22a45bb19fdb service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0790839 May 25 15:44:09.018901 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-d5229d3e-ea0c-4894-85e4-2848b276d0c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:09.020628 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-d5229d3e-ea0c-4894-85e4-2848b276d0c8 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 1100 time: 0.0737600 May 25 15:44:09.175526 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-38fed2e0-6309-437a-b65d-6a6d75cd8bd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:09.177023 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-38fed2e0-6309-437a-b65d-6a6d75cd8bd4 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1255074 May 25 15:44:09.311966 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-60208206-f410-4506-b324-1d9d74e5dfa6 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 200 len: 1002 time: 0.0984437 May 25 15:44:09.386842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-67cc520a-bbca-4358-a251-2df06925c2f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:09.388196 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-67cc520a-bbca-4358-a251-2df06925c2f7 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0572550 May 25 15:44:09.475705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-a5e78b75-468c-41eb-b2b3-a9f2689c045d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:09.477232 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-a5e78b75-468c-41eb-b2b3-a9f2689c045d service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0711610 May 25 15:44:09.617970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-f4975f90-bf2b-447e-9a71-27c096a0fdc5 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1235232 May 25 15:44:09.821262 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-026bdb6e-f339-48ec-a0b5-dc5b41e52f96 req-15ec1d88-30db-480b-9798-cc6b62a98025 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1816864 May 25 15:44:09.837147 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbf71bd-d895-4752-b37d-ef0e3e096acf req-75cc1b8c-2421-46bb-8d6d-3906ea11b0f3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:09.838593 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0dbf71bd-d895-4752-b37d-ef0e3e096acf req-75cc1b8c-2421-46bb-8d6d-3906ea11b0f3 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.1259556 May 25 15:44:09.882529 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0dbf71bd-d895-4752-b37d-ef0e3e096acf req-716d6b01-9d72-45ca-a439-8d0d054f2648 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383611 May 25 15:44:10.624309 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:11.066101 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e1697e-0f28-4717-a8b8-7d5ae1016613 req-ea771f35-f714-4393-99eb-fde1b0c9a660 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:11.067467 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-58e1697e-0f28-4717-a8b8-7d5ae1016613 req-ea771f35-f714-4393-99eb-fde1b0c9a660 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0816455 May 25 15:44:11.114018 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-58e1697e-0f28-4717-a8b8-7d5ae1016613 req-9254c9d1-f106-42ce-b55f-c084f8a906e7 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409253 May 25 15:44:11.991802 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45702) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:12.052625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Deleting subnet be107ecb-f575-4897-918d-5ad5567180d0 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:44:12.055496 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.103984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.160682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.434649 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b942b8d2-dd02-405b-83f3-5f341e285e22 req-7cfbf785-b2c7-4da3-a313-cd5f13a74281 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:12.436044 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b942b8d2-dd02-405b-83f3-5f341e285e22 req-7cfbf785-b2c7-4da3-a313-cd5f13a74281 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.2115910 May 25 15:44:12.498171 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b942b8d2-dd02-405b-83f3-5f341e285e22 req-e7d7631c-41cf-42bf-825d-2656b205a23a tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0545731 May 25 15:44:12.506310 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.510236 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:12.544136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=be107ecb-f575-4897-918d-5ad5567180d0,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:12.547095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:12.548075 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.554326 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-6e3735cc-85cc-48cd-bc6f-a997f803d9bf admin admin] 10.222.0.36 "DELETE /v2.0/subnets/be107ecb-f575-4897-918d-5ad5567180d0 HTTP/1.1" status: 204 len: 168 time: 0.5615053 May 25 15:44:12.556768 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45708) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:12.735736 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.854851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.867223 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71fe9388-47c1-4797-9687-8ab41ffa2ce9']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:12.878826 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:12.879117 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7f0a52ed-fcd5-43c2-bc2c-bceb95e7f402') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:12.890234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.905988 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.913542 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Releasing vlan 354 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:44:12.914092 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:44:12.927531 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:44:13.003148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.010096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.012768 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ece2fcf6-5199-4d7a-8974-cb22518d119c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.032231 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Pushing event deleted for resources: {'Network': ['ID=71fe9388-47c1-4797-9687-8ab41ffa2ce9,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:13.035159 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.036722 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-eec43ba5-9a74-4ae6-82f6-c76625416073 admin admin] 10.222.0.36 "DELETE /v2.0/networks/71fe9388-47c1-4797-9687-8ab41ffa2ce9 HTTP/1.1" status: 204 len: 168 time: 0.4790671 May 25 15:44:13.169469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45714) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:13.220192 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b3ccfe09-3523-4eed-bee9-7c1bf824794e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=b4d6b8a11a0d4e2c97f55bde6cd2c234&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0494857 May 25 15:44:13.222545 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45718) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:13.283487 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.309588 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.360953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.365076 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5bff31b3-bdf9-45cc-bc2f-0cbf3186aa20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:13.378224 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c337b9c8-3c18-4807-9e19-356be0c8c6e9,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:13.380754 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:13.389494 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.390686 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c337b9c8-3c18-4807-9e19-356be0c8c6e9 HTTP/1.1" status: 204 len: 168 time: 0.1672430 May 25 15:44:13.525719 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60db453c-3fce-4638-84c2-80b134b5961d req-caf7432a-6981-4062-8500-e6bd5725e5a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:13.527465 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-60db453c-3fce-4638-84c2-80b134b5961d req-caf7432a-6981-4062-8500-e6bd5725e5a1 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0870318 May 25 15:44:13.675377 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Deleting port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:44:13.675716 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.706516 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c600811-f66e-40dc-a669-b7cc8d918d3a req-2bd34dca-0e35-4eaf-a3b9-d38d8bdb4610 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:13.708284 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6c600811-f66e-40dc-a669-b7cc8d918d3a req-2bd34dca-0e35-4eaf-a3b9-d38d8bdb4610 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 945 time: 0.0918391 May 25 15:44:13.757587 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6c600811-f66e-40dc-a669-b7cc8d918d3a req-5b555b45-0f73-42b7-907d-0965175b2a55 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/security-groups?id=479311f7-8688-437c-b1d8-2645298577af&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428143 May 25 15:44:13.841259 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] For port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:13.841446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:13.974040 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Calling delete_port for 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:44:14.094898 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.105912 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:14.110755 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:44:14.157252 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Pushing event deleted for resources: {'Port': ['ID=62bd6a93-b70f-4e83-a70a-9b823ecbd7dc,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:14.160983 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:14.238499 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] No DVR routers for this DVR port 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:44:14.241235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:14.244036 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'name': 'network-vif-deleted', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:44:14.260920 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-60db453c-3fce-4638-84c2-80b134b5961d req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.70 "DELETE /v2.0/ports/62bd6a93-b70f-4e83-a70a-9b823ecbd7dc HTTP/1.1" status: 204 len: 173 time: 0.7233644 May 25 15:44:14.302523 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b62e88c-87e4-4020-9fc4-9b2cffdc55de', 'name': 'network-vif-deleted', 'tag': '62bd6a93-b70f-4e83-a70a-9b823ecbd7dc', 'status': 'completed', 'code': 200} May 25 15:44:14.933774 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5c511329-4a56-4eca-8892-fe9ed467a934 req-618800c0-911a-4ec9-a301-77371730ea2d tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] 10.222.0.36 "GET /v2.0/ports?device_id=1b62e88c-87e4-4020-9fc4-9b2cffdc55de HTTP/1.1" status: 200 len: 210 time: 0.0537579 May 25 15:44:16.035663 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45772) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:16.654919 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.051111 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Deleting port 2bf9f916-b14b-404f-af5d-32a215af7bab {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:44:17.051782 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.168282 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] For port 2bf9f916-b14b-404f-af5d-32a215af7bab, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=2bf9f916-b14b-404f-af5d-32a215af7bab,segment=NetworkSegment(b90cd672-6077-4a06-b3ec-e05219e8e214),segment_id=b90cd672-6077-4a06-b3ec-e05219e8e214)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:17.168628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.287608 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Calling delete_port for 2bf9f916-b14b-404f-af5d-32a215af7bab owned by network:router_interface {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:44:17.563849 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:17.567253 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7c226a88-118b-426a-9d6d-e1c2a1fdf663 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:17.611904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Pushing event deleted for resources: {'Port': ['ID=2bf9f916-b14b-404f-af5d-32a215af7bab,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:17.615364 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:17.942310 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.003213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:44:18.040306 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:44:18.040667 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62bd6a93-b70f-4e83-a70a-9b823ecbd7dc not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:44:18.295852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Router 11ba60b2-4c9b-4c79-921e-91355709c4b2 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:44:18.473213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:18.481588 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Sync routers for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:18.485285 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] 10.222.0.36 "PUT /v2.0/routers/11ba60b2-4c9b-4c79-921e-91355709c4b2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4484739 May 25 15:44:18.487730 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45784) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:18.490479 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:18.491092 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:18.661125 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.666554 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:18.834495 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.905746 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Deleting port 4f835a90-3c22-4814-8461-fb62812ddc7d {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:44:18.906089 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:18.943728 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171'}], 'enable_snat': True}, 'gw_port_id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:44:17Z', 'revision_number': 5, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port': {'id': '4f835a90-3c22-4814-8461-fb62812ddc7d', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:ad:06', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.171', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:40:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:18.947366 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Checking router: 11ba60b2-4c9b-4c79-921e-91355709c4b2 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:18.955378 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Routers {'11ba60b2-4c9b-4c79-921e-91355709c4b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:18.956521 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['11ba60b2-4c9b-4c79-921e-91355709c4b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:19.032468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] For port 4f835a90-3c22-4814-8461-fb62812ddc7d, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4f835a90-3c22-4814-8461-fb62812ddc7d,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:19.032823 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.132439 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] Set router 11ba60b2-4c9b-4c79-921e-91355709c4b2 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:19.236071 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:44:18Z', 'revision_number': 6, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:19.240642 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-405fb9e4-b11f-4251-bf98-dbebe2fcf3f9 None None] The sync data for ids ['11ba60b2-4c9b-4c79-921e-91355709c4b2'] in dv-cinder-791239-3-iscsi is: [{'id': '11ba60b2-4c9b-4c79-921e-91355709c4b2', 'name': 'tempest-ServerRescueNegativeTestJSON-1467283829-router', 'tenant_id': '0a695c168ea64d4f96c9e8751a6875ca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:50Z', 'updated_at': '2021-05-25T15:44:18Z', 'revision_number': 6, 'project_id': '0a695c168ea64d4f96c9e8751a6875ca', 'gw_port_host': None}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:19.251443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Calling delete_port for 4f835a90-3c22-4814-8461-fb62812ddc7d owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:44:19.395587 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.399065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6d82f4b6-8fbe-47bb-9232-5fc02cad1597 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:19.445085 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Pushing event deleted for resources: {'Port': ['ID=4f835a90-3c22-4814-8461-fb62812ddc7d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:19.448153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:19.533964 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.710074 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.712250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.794783 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.795202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Fanout notify agent at l3_agent the message router_deleted on router 11ba60b2-4c9b-4c79-921e-91355709c4b2 {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:44:19.807878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.811594 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] 10.222.0.36 "DELETE /v2.0/routers/11ba60b2-4c9b-4c79-921e-91355709c4b2 HTTP/1.1" status: 204 len: 168 time: 1.3204443 May 25 15:44:19.812110 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45794) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:19.875683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Deleting subnet eae8c611-60f5-420f-b883-17fbae330f18 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:44:19.878578 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.925358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:19.978469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.231473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.235828 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84c59448-5f0b-43a1-8c79-937d8d55bd60 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.274776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=eae8c611-60f5-420f-b883-17fbae330f18,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:20.277623 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.278590 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.286767 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-cdff5c5d-95d0-42a7-a294-59df7759b56b admin admin] 10.222.0.36 "DELETE /v2.0/subnets/eae8c611-60f5-420f-b883-17fbae330f18 HTTP/1.1" status: 204 len: 168 time: 0.4711123 May 25 15:44:20.286981 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45798) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:20.391594 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.513781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.526860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['db198222-1495-44ec-99cd-cc38de1c71df']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:20.545859 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b90cd672-6077-4a06-b3ec-e05219e8e214') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:20.546329 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b90cd672-6077-4a06-b3ec-e05219e8e214') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:20.558921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.657567 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.664806 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Releasing vlan 355 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:44:20.665187 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:44:20.678868 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:44:20.756031 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.761359 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:20.765581 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-eef74559-a054-4969-9ef7-66f659f0ad28 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:20.787904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Pushing event deleted for resources: {'Network': ['ID=db198222-1495-44ec-99cd-cc38de1c71df,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:20.791223 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:20.795527 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-82aafdac-c48b-450b-9354-6b5ad2cba50e admin admin] 10.222.0.36 "DELETE /v2.0/networks/db198222-1495-44ec-99cd-cc38de1c71df HTTP/1.1" status: 204 len: 168 time: 0.5051658 May 25 15:44:20.973540 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45814) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:21.022051 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-84795f87-eb12-45b7-9d52-8b17a4332184 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=0a695c168ea64d4f96c9e8751a6875ca&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0473375 May 25 15:44:21.024384 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45818) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:21.082602 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.108202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.160170 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.164744 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0da3eb44-1684-4c43-9ae7-b9d488837702 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:21.177263 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=479311f7-8688-437c-b1d8-2645298577af,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:21.179812 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:21.188285 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:21.189569 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-9c59c4c8-664c-4048-a5e4-64e5667a00f4 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/479311f7-8688-437c-b1d8-2645298577af HTTP/1.1" status: 204 len: 168 time: 0.1640351 May 25 15:44:21.299926 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4f835a90-3c22-4814-8461-fb62812ddc7d no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:44:21.333788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 4f835a90-3c22-4814-8461-fb62812ddc7d {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:44:21.334140 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4f835a90-3c22-4814-8461-fb62812ddc7d not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:44:21.334556 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 2bf9f916-b14b-404f-af5d-32a215af7bab no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:44:21.367731 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 2bf9f916-b14b-404f-af5d-32a215af7bab {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:44:21.368118 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 2bf9f916-b14b-404f-af5d-32a215af7bab not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:44:23.056646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45888) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:23.172550 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.186546 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:23.190337 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Usage tracker for resource:security_group_rule and tenant:32783cff5eb44db3a0bdd13a5e3e7ff4 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:23.193273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:23.198920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:23.281830 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.288518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.296848 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e88749c3-0e85-4609-ab5d-67970e870c63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.335496 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=32783cff5eb44db3a0bdd13a5e3e7ff4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2777357 May 25 15:44:23.337116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ed708e3-5801-49a7-bc9c-9c8a666a74ca,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.338829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 45898) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:23.340595 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.405363 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.432925 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.528486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.534933 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1a345c04-7d14-4f25-b3c7-e1e0abe5c705 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:23.548193 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ed708e3-5801-49a7-bc9c-9c8a666a74ca,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:23.552607 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:23.556984 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.558083 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/3ed708e3-5801-49a7-bc9c-9c8a666a74ca HTTP/1.1" status: 204 len: 168 time: 0.2181301 May 25 15:44:23.583225 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292cea8f-4126-46a1-aa66-da3b29a6feef req-1834fb0e-9e63-43c7-be9d-6eb1c1cd8e89 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:23.591116 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-292cea8f-4126-46a1-aa66-da3b29a6feef req-1834fb0e-9e63-43c7-be9d-6eb1c1cd8e89 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1131172 May 25 15:44:23.640030 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-292cea8f-4126-46a1-aa66-da3b29a6feef req-89f85713-ec77-4d35-af00-fdd41a899257 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419743 May 25 15:44:23.837176 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 45908) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:23.854680 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:23.869135 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:23.872904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Usage tracker for resource:security_group_rule and tenant:a81752fc1df34e768e2621e6b3cf408f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:23.875647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:23.881300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:24.035267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.039878 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.046420 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.086739 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=a81752fc1df34e768e2621e6b3cf408f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2484784 May 25 15:44:24.087689 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b34c296-2934-4477-b124-70039d4b4597,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:24.089492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45916) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:24.091267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.154174 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.181968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.237732 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.242387 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e4ccbef1-bf2a-46a7-a401-f18dbd404a43 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.256192 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b34c296-2934-4477-b124-70039d4b4597,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:24.259005 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.264797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.268099 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/5b34c296-2934-4477-b124-70039d4b4597 HTTP/1.1" status: 204 len: 168 time: 0.1753883 May 25 15:44:24.322990 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45924) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:24.551844 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.566028 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:24.570222 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Usage tracker for resource:security_group_rule and tenant:f55d6fadcad646ee86ef18eb0de62b9b is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:24.573412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:24.579254 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:24.664094 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.675523 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:44:24.677080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.685706 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-62bd757f-6e32-4e39-93b4-ef1c53afae68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.724950 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=f55d6fadcad646ee86ef18eb0de62b9b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4007916 May 25 15:44:24.725852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=869e3370-1702-42e0-8daa-b0cdc158229b,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:24.728041 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 45946) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:24.729205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.797416 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.831438 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.856867 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 req-fffa8d72-acc4-486b-9fc3-06e29174aec5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:24.858616 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 req-fffa8d72-acc4-486b-9fc3-06e29174aec5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0972297 May 25 15:44:24.891565 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.896663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5e7de775-09a1-4a5c-9039-3339d9be5c91 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:24.905162 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e18daf91-ccf9-4e76-85c3-a0c05b18b2e0 req-4d6229e3-9548-498c-a962-96d674029570 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400312 May 25 15:44:24.913112 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=869e3370-1702-42e0-8daa-b0cdc158229b,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:24.917403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:24.930356 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:24.930356 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/869e3370-1702-42e0-8daa-b0cdc158229b HTTP/1.1" status: 204 len: 168 time: 0.1962481 May 25 15:44:25.766978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 45998) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:25.871756 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1362224187-network', 'tenant_id': '9276d22c6df545f2a056d5059899b85f'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:25.876268 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:25.880540 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Usage tracker for resource:network and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:25.883518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:25.890285 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:25.900978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Made reservation on behalf of 9276d22c6df545f2a056d5059899b85f for: {'network': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:25.903397 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:25.915854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:25.930052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:25.933923 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:25.936772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:25.943541 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:26.033747 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.037982 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.042102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-47642fe8-f251-4413-aeda-78f5bf88fce4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:26.066057 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 358} {{(pid=98462) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:44:26.078779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=076fd7c9-a1ff-4e1a-bf26-5c48af0e8380,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:26.083302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:26.084378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.084726 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.segments_db [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Added segment bb2550ff-05c6-4e65-a727-67a511075e2d of type vlan for network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 May 25 15:44:26.112578 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.119524 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49823f5-9cda-451d-ac95-826dd4b0ef87 req-7fca2f32-dcfb-4dd6-bdae-4b11a86cee43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:26.121606 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d49823f5-9cda-451d-ac95-826dd4b0ef87 req-7fca2f32-dcfb-4dd6-bdae-4b11a86cee43 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0912507 May 25 15:44:26.150250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.151609 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:26.152265 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.157173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:26.170665 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d49823f5-9cda-451d-ac95-826dd4b0ef87 req-e70e2541-5ce7-4e87-b2d5-53678465d731 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419672 May 25 15:44:26.259233 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Pushing event updated for resources: {'Network': ['ID=bef3b39e-4efb-47b6-ab09-ddc4c406ab32,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:26.265226 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:26.275513 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:44:26.288864 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5208025 May 25 15:44:26.289442 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46008) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:26.299521 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Request body: {'subnet': {'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1362224187-subnet', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:26.315789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:26.326430 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Usage tracker for resource:subnet and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:26.332378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:26.342553 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:26.360319 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Made reservation on behalf of 9276d22c6df545f2a056d5059899b85f for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:26.365388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.791227 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.795926 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:26.863483 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ce334cf7-ad8f-4d17-8efa-939b870abd6d,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:26.866770 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:26.872342 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Checking segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:26.872696 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Network hostable DHCP agents. Network: bef3b39e-4efb-47b6-ab09-ddc4c406ab32, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:44:26.888808 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:44:26.898130 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, bef3b39e-4efb-47b6-ab09-ddc4c406ab32) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:26.906985 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2a20c7f1-38a1-4043-baaa-93fe78d6501b None None] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:26.909648 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:26.910307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.931067 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6404667 May 25 15:44:26.933850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46014) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:26.938892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:26.944501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:26.948613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Usage tracker for resource:router and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:26.951515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:26.957357 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:26.970605 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.971588 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:26.987190 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.144078 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:44:27.144895 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.253435 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.301377 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Allocated IP 172.20.0.2 (bef3b39e-4efb-47b6-ab09-ddc4c406ab32/ce334cf7-ad8f-4d17-8efa-939b870abd6d/98a5ce70-6d5e-4cc7-83ca-522a54fff8cd) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:27.432665 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-247078f6-4acc-4cd7-b955-e4c072bcadad req-ff7d4cc5-fcac-4be2-9acc-f164aab4d8d0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:27.434701 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-247078f6-4acc-4cd7-b955-e4c072bcadad req-ff7d4cc5-fcac-4be2-9acc-f164aab4d8d0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1080964 May 25 15:44:27.493774 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-247078f6-4acc-4cd7-b955-e4c072bcadad req-4729aec5-9487-4678-a136-764b90aaadc0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497591 May 25 15:44:27.515788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.522569 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Transition to ACTIVE for port object 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:27.541807 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Transition to ACTIVE for port object 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:27.549093 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.553888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:27.619894 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:27.622981 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:27.626675 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:27.636163 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Pushing event updated for resources: {'Port': ['ID=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:27.676601 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.676949 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.677373 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.677795 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.678228 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.678645 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.679058 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.679468 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.679901 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.680359 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.680767 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.681216 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:27.709203 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:27.735428 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Attempting to bind port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:27.735970 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Attempting to bind port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:27.736426 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Attempting to bind port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd on network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:27.741850 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:27.742358 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Checking segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:27.742851 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.743349 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Bound using segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:27.743919 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Bound port: 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:27.744398 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.793811 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.825613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.851026 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] For port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:27.854234 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] For port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:27.857813 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:27.861276 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:27.933438 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Pushing event updated for resources: {'Port': ['ID=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:27.936828 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:27.971580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Allocated IP 172.27.0.39 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/a31ebfd2-e685-4d60-a02a-3c48be8a8d3e) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:28.139317 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:28.174777 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:28.178555 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-911d1cb2-c6f4-461b-a21a-a7817ec409c4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:28.248834 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:28.251358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:28.255472 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:28.284856 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Pushing event updated for resources: {'Port': ['ID=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:28.290564 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:28.673285 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:28.689437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e687f528-c96b-451b-bd54-e9a596da069c req-76cad68d-b021-479b-942c-5579875718d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:28.691714 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e687f528-c96b-451b-bd54-e9a596da069c req-76cad68d-b021-479b-942c-5579875718d6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0911183 May 25 15:44:28.737968 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e687f528-c96b-451b-bd54-e9a596da069c req-d02b57d2-7d69-4d15-a752-7550ac598c4d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404108 May 25 15:44:28.872139 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e984af0-0c8d-4a5c-8e1c-500a0b79e9c1 None None] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:28.956993 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-56d9b13d-43ce-4ee4-8122-45daa0dfa83a None None] Provisioning for port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:29.026585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:29.331052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Router 333e9bb6-af7f-4e54-8e33-f669ec06856d is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98462) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:44:29.348727 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:29.417005 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:29.421405 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:29.421779 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:29.510616 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:29.527272 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Sync routers for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:29.536299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:29.537527 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.6027019 May 25 15:44:29.540241 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46030) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:29.548125 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:29.556394 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:29.557012 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:29.707971 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:29.724149 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:29.727815 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:29.843709 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:29.949105 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:29.965227 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:30.038190 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-395e7010-8d99-4373-b55a-b0a1283d1d20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.084788 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b49266f1-a01f-4097-a966-4a2ec62ce07e req-bab5c2cb-afe8-47b1-ab75-bd0f0ac6f75a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:30.086255 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b49266f1-a01f-4097-a966-4a2ec62ce07e req-bab5c2cb-afe8-47b1-ab75-bd0f0ac6f75a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.2211783 May 25 15:44:30.141458 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:28Z', 'revision_number': 3, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:27Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:30.145417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Checking router: 333e9bb6-af7f-4e54-8e33-f669ec06856d for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:30.145773 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Updating router 333e9bb6-af7f-4e54-8e33-f669ec06856d port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:30.154291 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b49266f1-a01f-4097-a966-4a2ec62ce07e req-010fc71a-7d86-44a5-b559-cf086d310153 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544333 May 25 15:44:30.202159 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.309678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.514429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Allocated IP 172.20.0.1 (bef3b39e-4efb-47b6-ab09-ddc4c406ab32/ce334cf7-ad8f-4d17-8efa-939b870abd6d/462d06b3-a029-444b-bf67-dda89e9f0a73) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:30.530048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.542416 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Transition to ACTIVE for port object a31ebfd2-e685-4d60-a02a-3c48be8a8d3e will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:30.550014 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.554002 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:30.631335 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Attempting to bind port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:30.631769 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Attempting to bind port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:30.632105 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Attempting to bind port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:30.634365 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Pushing event updated for resources: {'Port': ['ID=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:30.638456 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:30.641151 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:30.641519 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:30.642591 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.642591 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:30.643431 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Bound port: a31ebfd2-e685-4d60-a02a-3c48be8a8d3e, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:30.643820 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.719654 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] For port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:30.723738 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] For port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:30.727914 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.732236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:30.780694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.797055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Transition to ACTIVE for port object 462d06b3-a029-444b-bf67-dda89e9f0a73 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:30.805067 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:30.805690 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:30.821762 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:30.825638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:30.883142 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Pushing event updated for resources: {'Port': ['ID=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:30.886989 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:30.887111 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:30.890065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:30.894002 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:30.934945 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Pushing event updated for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:30.942802 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:30.958372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.006670 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:31.193694 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-65a99926-09d2-41da-b948-729957e74d51 None None] Provisioning for port 462d06b3-a029-444b-bf67-dda89e9f0a73 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:31.208160 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-65a99926-09d2-41da-b948-729957e74d51 None None] Provisioning complete for port 462d06b3-a029-444b-bf67-dda89e9f0a73 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:31.208543 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-65a99926-09d2-41da-b948-729957e74d51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.215236 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.281105 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-65a99926-09d2-41da-b948-729957e74d51 None None] Port 462d06b3-a029-444b-bf67-dda89e9f0a73 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:31.352074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:31.359486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 req-83c826e5-46a3-4661-8ce3-95018aa6d6cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:31.361148 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 req-83c826e5-46a3-4661-8ce3-95018aa6d6cf tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0916464 May 25 15:44:31.414781 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-93eb1707-d9e0-4620-a7fc-2c9d27ef8033 req-922c2e8c-d280-4c57-8610-a3b1427801e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460892 May 25 15:44:31.459409 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:28Z', 'revision_number': 3, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:31.464212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.467459 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afb4b2d5-b56c-4c3c-8897-c08106e06ecb None None] The sync data for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi is: [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:28Z', 'revision_number': 3, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:31.469745 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.481179 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:31.481558 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.496422 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6a8805ef-cb8b-44e5-bde0-3da3ab0a9c20 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:31.584842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Pushing event updated for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:31.588156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:31.588931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:31.737644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:31.739170 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:31.944694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Router 333e9bb6-af7f-4e54-8e33-f669ec06856d has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:44:32.012256 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-935a920f-93ac-4d44-a41f-80a48cdd9a00 None None] Provisioning complete for port 462d06b3-a029-444b-bf67-dda89e9f0a73 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:32.012749 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-935a920f-93ac-4d44-a41f-80a48cdd9a00 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.077018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-935a920f-93ac-4d44-a41f-80a48cdd9a00 None None] Port 462d06b3-a029-444b-bf67-dda89e9f0a73 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:32.143629 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:32.156023 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] 10.222.0.36 "PUT /v2.0/routers/333e9bb6-af7f-4e54-8e33-f669ec06856d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6116538 May 25 15:44:32.635982 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.679772 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a4ea1b08-0776-4d67-841b-b3464d605079 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.740467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46076) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:32.746507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1692893011-network', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:32.752195 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:32.753797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a3a653-72ec-48ff-a784-9766af35ab04 req-6f59896a-0aef-438d-a528-fea1d4c23495 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:32.755458 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b5a3a653-72ec-48ff-a784-9766af35ab04 req-6f59896a-0aef-438d-a528-fea1d4c23495 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.2276292 May 25 15:44:32.756394 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Usage tracker for resource:network and tenant:4d92794aeb894cfd99077fb5ebd9b29e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:32.759284 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:32.765960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:32.779156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Made reservation on behalf of 4d92794aeb894cfd99077fb5ebd9b29e for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:32.782092 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.794745 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.805509 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b5a3a653-72ec-48ff-a784-9766af35ab04 req-86f83bb0-d39f-4511-a071-9c9f017d689f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442622 May 25 15:44:32.810104 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:32.816286 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Usage tracker for resource:security_group_rule and tenant:4d92794aeb894cfd99077fb5ebd9b29e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:32.819298 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:32.825241 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:32.913035 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.916819 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.919682 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-63176478-69a1-455c-aea3-567ecaddc6c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:32.944882 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 355} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:44:32.958045 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26552406-b235-449f-b0e2-e0db8415da06,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:32.961969 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:32.964414 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:32.964750 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Added segment 56c9b3b5-cb9c-4287-8c22-43adc9b03d9e of type vlan for network 89cbf153-f088-4f8c-8165-498b7d56e2fd May 25 15:44:32.992977 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.022894 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.024310 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:33.024886 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.029465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-57d75f50-5830-48bb-a344-c32439196bac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:33.065729 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Sync routers for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:33.074904 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:33.075516 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:33.129592 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3878984 May 25 15:44:33.132420 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46082) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:33.140079 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Request body: {'subnet': {'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1692893011-subnet', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:33.143231 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Pushing event updated for resources: {'Network': ['ID=89cbf153-f088-4f8c-8165-498b7d56e2fd,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:33.146361 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:33.147259 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:33.151419 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Usage tracker for resource:subnet and tenant:4d92794aeb894cfd99077fb5ebd9b29e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:33.154060 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:33.154564 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:44:33.159820 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:33.170188 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Made reservation on behalf of 4d92794aeb894cfd99077fb5ebd9b29e for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:44:33.172577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.258566 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:33.360742 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device a31ebfd2-e685-4d60-a02a-3c48be8a8d3e up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:33.443749 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.447440 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:33.452521 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:33.452896 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.571653 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.588531 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:33.592679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.597525 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.598767 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:33.600009 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:33.606333 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:30Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 2, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:33.610289 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Checking router: 333e9bb6-af7f-4e54-8e33-f669ec06856d for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:33.610648 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Updating router 333e9bb6-af7f-4e54-8e33-f669ec06856d port 462d06b3-a029-444b-bf67-dda89e9f0a73 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:33.669791 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:33.670014 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.672908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:33.676002 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1a27ea4-f8a7-4d92-acd2-417c203ea7b2,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:33.684145 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:33.686549 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Checking segment: {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:33.686904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Network hostable DHCP agents. Network: 89cbf153-f088-4f8c-8165-498b7d56e2fd, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:44:33.705423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:44:33.715400 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 89cbf153-f088-4f8c-8165-498b7d56e2fd) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:33.725418 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63f811d7-9cd6-4ec9-bf36-215b22a616d5 None None] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:33.726909 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:33.727502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.753494 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6200600 May 25 15:44:33.755949 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46088) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:33.761366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:33.766640 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:33.770915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Usage tracker for resource:router and tenant:4d92794aeb894cfd99077fb5ebd9b29e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:33.773995 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:33.780095 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:33.796134 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-765781', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-130887'] for router, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.797136 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-766805', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-763018', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-545639', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-130892'] for router, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.813490 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:33.964589 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp8dec7391-b9d9-52c1-ba50-1caf22509045-89cbf153-f088-4f8c-8165-498b7d56e2fd', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2'}]}} from dv-cinder-791239-3-iscsi. {{(pid=98464) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 15:44:33.966052 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.058500 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.071621 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Transition to ACTIVE for port object 462d06b3-a029-444b-bf67-dda89e9f0a73 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:34.078240 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.082383 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-c444106e-3550-4d5b-9dd8-461d07ca663f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:34.130221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.db_base_plugin_common [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Allocated IP 172.20.0.2 (89cbf153-f088-4f8c-8165-498b7d56e2fd/c1a27ea4-f8a7-4d92-acd2-417c203ea7b2/ff2be4fa-3221-4970-8775-712ce1d7b2db) {{(pid=98464) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:34.228254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-763055', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-765799', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-130874'] for router, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.234307 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Pushing event updated for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:34.286410 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.286725 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.287047 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.287369 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.288044 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.288044 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.288339 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.288614 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.288945 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.289259 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.289573 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.289866 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98465) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:44:34.298648 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:34.316101 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Attempting to bind port 462d06b3-a029-444b-bf67-dda89e9f0a73 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:34.316810 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Attempting to bind port 462d06b3-a029-444b-bf67-dda89e9f0a73 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:34.317332 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Attempting to bind port 462d06b3-a029-444b-bf67-dda89e9f0a73 on network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:34.323519 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:34.324204 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Checking segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:34.324602 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.325032 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Bound using segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:34.325449 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Bound port: 462d06b3-a029-444b-bf67-dda89e9f0a73, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:34.325820 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.370242 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc req-38ab0427-904b-40a6-88a4-bb02bd23c0f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:34.372296 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc req-38ab0427-904b-40a6-88a4-bb02bd23c0f4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.3189180 May 25 15:44:34.372804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks [] for port, precommit_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.385489 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Transition to ACTIVE for port object ff2be4fa-3221-4970-8775-712ce1d7b2db will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:34.419712 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Transition to ACTIVE for port object ff2be4fa-3221-4970-8775-712ce1d7b2db will not be triggered until provisioned by entity DHCP. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:34.427517 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755'] for port, after_create {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.431496 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-f3b1cbc7-f543-4f69-a0ae-09f2a246ffc9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:34.437321 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1e5a2c3d-cf26-49d9-bfc7-44d25c320ccc req-b122ccc9-412a-42be-b1d2-09ac27433f3b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579123 May 25 15:44:34.442018 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] For port 462d06b3-a029-444b-bf67-dda89e9f0a73, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:34.446314 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] For port 462d06b3-a029-444b-bf67-dda89e9f0a73, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=462d06b3-a029-444b-bf67-dda89e9f0a73,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:34.452242 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.458691 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:34.502091 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd is already hosted by enough agents. {{(pid=98464) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:34.505376 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.scheduler.base_scheduler [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Resources bound (agent type, host, resource id): {{(pid=98464) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:34.509194 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Received port after_create {{(pid=98464) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:34.550557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Pushing event updated for resources: {'Port': ['ID=ff2be4fa-3221-4970-8775-712ce1d7b2db,revision_number=1']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:34.559444 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:34.573687 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:34.574388 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:34.620607 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Attempting to bind port ff2be4fa-3221-4970-8775-712ce1d7b2db on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:34.621236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Attempting to bind port ff2be4fa-3221-4970-8775-712ce1d7b2db by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:34.621775 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Attempting to bind port ff2be4fa-3221-4970-8775-712ce1d7b2db on network 89cbf153-f088-4f8c-8165-498b7d56e2fd {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:34.628288 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:34.628876 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Checking segment: {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:34.629443 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.630124 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Bound using segment: {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:34.630760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Bound port: ff2be4fa-3221-4970-8775-712ce1d7b2db, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:34.631296 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.653744 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Pushing event updated for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=4']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:34.658320 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-643aea5d-817a-4ba3-97ed-d0b95b3e8a96 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:34.671953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.703814 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.724842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] For port ff2be4fa-3221-4970-8775-712ce1d7b2db, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:34.728870 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] For port ff2be4fa-3221-4970-8775-712ce1d7b2db, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ff2be4fa-3221-4970-8775-712ce1d7b2db,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:34.735724 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:34.741118 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:34.820181 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:34.838841 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Pushing event updated for resources: {'Port': ['ID=ff2be4fa-3221-4970-8775-712ce1d7b2db,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:34.851906 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:34.872096 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Allocated IP 172.27.0.43 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/5f37aeac-39b6-49c9-aee9-e8ce768bb421) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:35.058083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.093266 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.098688 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:35.166516 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.171103 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:35.174386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:35.177872 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:35.190383 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:34Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:35.194750 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df9ecc7f-43d1-4685-8bf7-8c882fd14e41 None None] The sync data for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi is: [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:34Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:35.221675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Pushing event updated for resources: {'Port': ['ID=5f37aeac-39b6-49c9-aee9-e8ce768bb421,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:35.229195 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:35.469288 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ff2be4fa-3221-4970-8775-712ce1d7b2db up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:35.547532 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port ff2be4fa-3221-4970-8775-712ce1d7b2db completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:35.553513 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 462d06b3-a029-444b-bf67-dda89e9f0a73 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:35.689005 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 462d06b3-a029-444b-bf67-dda89e9f0a73 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:35.696640 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 462d06b3-a029-444b-bf67-dda89e9f0a73 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:35.698353 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.726165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cdd1439-e8a1-4bba-93c2-babd331270e9 req-352e71b0-07ad-4f7c-96c2-f0341d596489 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:35.727925 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8cdd1439-e8a1-4bba-93c2-babd331270e9 req-352e71b0-07ad-4f7c-96c2-f0341d596489 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1558514 May 25 15:44:35.796466 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8cdd1439-e8a1-4bba-93c2-babd331270e9 req-21a382f8-5a85-4fb1-b037-eae599631d4b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595856 May 25 15:44:35.858716 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.868327 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.904760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 462d06b3-a029-444b-bf67-dda89e9f0a73, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=462d06b3-a029-444b-bf67-dda89e9f0a73,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:35.910230 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:35.911037 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device a31ebfd2-e685-4d60-a02a-3c48be8a8d3e up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:35.949306 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:36.000520 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1a52b31-5113-4e8b-8d0e-33e63a69ea17 None None] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:44:36.133641 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Provisioning for port ff2be4fa-3221-4970-8775-712ce1d7b2db completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:36.158945 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:36.162345 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:36.163289 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Provisioning complete for port ff2be4fa-3221-4970-8775-712ce1d7b2db triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:36.163667 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.243913 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-765788', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-763116'] for router, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.266813 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:36.267194 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.462618 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Router 4af4a15f-6847-4985-8c5c-e2467f1831b2 is scheduled to L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 with binding_index 1 {{(pid=98463) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 15:44:36.502714 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.557374 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] For port ff2be4fa-3221-4970-8775-712ce1d7b2db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ff2be4fa-3221-4970-8775-712ce1d7b2db,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:36.565875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.567801 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8c581c22-37f1-4f88-a9e6-8cf200bb9202 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:36.639166 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Pushing event updated for resources: {'Port': ['ID=ff2be4fa-3221-4970-8775-712ce1d7b2db,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:36.642723 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:36.645093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:36.656369 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Sync routers for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:36.666213 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:36.666996 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:36.670658 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.672458 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e35ad93b-850c-427a-9432-88439d70d29b admin admin] 10.222.0.36 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.9153728 May 25 15:44:36.675961 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46102) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:36.843465 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-23fcc64a-9a07-4224-9cb1-e2f5dfe38362 None None] Provisioning complete for port ff2be4fa-3221-4970-8775-712ce1d7b2db triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:36.843775 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-23fcc64a-9a07-4224-9cb1-e2f5dfe38362 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:36.905070 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:37.256473 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 3, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:37.260695 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Checking router: 4af4a15f-6847-4985-8c5c-e2467f1831b2 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:37.261433 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Updating router 4af4a15f-6847-4985-8c5c-e2467f1831b2 port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 binding host dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:37.298022 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f900137-75f7-4e74-b8ff-859984257be3 req-556ac916-2629-4282-b9ae-038412d5ca0b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:37.300125 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f900137-75f7-4e74-b8ff-859984257be3 req-556ac916-2629-4282-b9ae-038412d5ca0b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.3577549 May 25 15:44:37.342561 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ff2be4fa-3221-4970-8775-712ce1d7b2db up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:37.410543 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.418588 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f900137-75f7-4e74-b8ff-859984257be3 req-5862f5e5-2c35-4cb9-a1a1-fa496325ba8c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708363 May 25 15:44:37.523304 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port ff2be4fa-3221-4970-8775-712ce1d7b2db triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:37.523932 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.582485 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.766280 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 462d06b3-a029-444b-bf67-dda89e9f0a73 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:37.786876 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Allocated IP 172.20.0.1 (89cbf153-f088-4f8c-8165-498b7d56e2fd/c1a27ea4-f8a7-4d92-acd2-417c203ea7b2/3653baa1-04ab-4037-9279-36fa2a5f66e1) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:44:37.903748 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 462d06b3-a029-444b-bf67-dda89e9f0a73 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:37.904153 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.933967 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.950054 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.provisioning_blocks [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Transition to ACTIVE for port object 3653baa1-04ab-4037-9279-36fa2a5f66e1 will not be triggered until provisioned by entity DHCP. {{(pid=98463) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:37.957115 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks [] for port, precommit_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.974737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.975390 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Transition to ACTIVE for port object 5f37aeac-39b6-49c9-aee9-e8ce768bb421 will not be triggered until provisioned by entity L2. {{(pid=98464) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:37.979378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf3ddaed-ae2b-4199-910a-3e4c74d9a569 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:37.983980 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:37.989111 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-17c2e010-c29b-4846-972e-de9c9ff386f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:38.039892 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:38.042652 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:38.046074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:44:38.093807 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Pushing event updated for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:38.099684 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.110613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Attempting to bind port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:38.110613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Attempting to bind port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:38.110901 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Attempting to bind port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 on network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:38.115381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-762013'] for router_interface, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.119737 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Pushing event updated for resources: {'Port': ['ID=5f37aeac-39b6-49c9-aee9-e8ce768bb421,revision_number=2']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:38.126083 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.128848 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:38.129238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Checking segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98464) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:38.129649 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.130317 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Bound using segment: {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'} {{(pid=98464) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:38.130524 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.managers [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Bound port: 5f37aeac-39b6-49c9-aee9-e8ce768bb421, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '68db3f28-5dc9-4720-b834-2eec1a899865', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}}] {{(pid=98464) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:38.130905 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.216878 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] For port 5f37aeac-39b6-49c9-aee9-e8ce768bb421, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98464) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:38.221885 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] For port 5f37aeac-39b6-49c9-aee9-e8ce768bb421, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=5f37aeac-39b6-49c9-aee9-e8ce768bb421,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:38.226391 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.230608 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:38.247107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.315534 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:38.316112 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:38.384030 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Pushing event updated for resources: {'Port': ['ID=5f37aeac-39b6-49c9-aee9-e8ce768bb421,revision_number=3']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:38.395644 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.396500 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-65611af4-740a-4ff1-8402-c94724072ffc None None] Provisioning for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:38.405279 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-65611af4-740a-4ff1-8402-c94724072ffc None None] Provisioning complete for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:38.405584 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-65611af4-740a-4ff1-8402-c94724072ffc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.498027 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.504264 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.538187 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:38.569909 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-65611af4-740a-4ff1-8402-c94724072ffc None None] Port 3653baa1-04ab-4037-9279-36fa2a5f66e1 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:38.588102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:38.639070 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Pushing event updated for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:38.644402 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:38.645282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-583199', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-761904'] for router_interface, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.657776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 req-bef1ee56-fd7b-418d-9a44-97a14cab171f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:38.660029 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 req-bef1ee56-fd7b-418d-9a44-97a14cab171f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1053793 May 25 15:44:38.716517 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4b7c0602-e7ec-4a8d-8ddd-5534f7ef6733 req-2ff51773-85ca-43b6-9287-bf3ad3963348 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501094 May 25 15:44:38.801190 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:44:38.802448 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:44:38.976825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '3653baa1-04ab-4037-9279-36fa2a5f66e1', 'name': '', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'mac_address': 'fa:16:3e:72:76:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:37Z', 'updated_at': '2021-05-25T15:44:37Z', 'revision_number': 1, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'subnets': [{'id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:38.984354 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13040344-92fe-464b-86b7-bfc63e49a7f5 None None] The sync data for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi is: [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '3653baa1-04ab-4037-9279-36fa2a5f66e1', 'name': '', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'mac_address': 'fa:16:3e:72:76:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:37Z', 'updated_at': '2021-05-25T15:44:37Z', 'revision_number': 1, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'subnets': [{'id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:38.994825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-a2e6c704-571b-48e2-aa2a-c2ca4751be07 None None] Provisioning complete for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:38.995209 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a2e6c704-571b-48e2-aa2a-c2ca4751be07 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:38.998435 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Router 4af4a15f-6847-4985-8c5c-e2467f1831b2 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:44:39.063151 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-a2e6c704-571b-48e2-aa2a-c2ca4751be07 None None] Port 3653baa1-04ab-4037-9279-36fa2a5f66e1 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:44:39.297546 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:44:39.308282 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] 10.222.0.36 "PUT /v2.0/routers/4af4a15f-6847-4985-8c5c-e2467f1831b2/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6308453 May 25 15:44:39.815560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46142) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:39.823715 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-833018644', 'description': 'tempest-secgroup-smoke-833018644 description', 'project_id': '9276d22c6df545f2a056d5059899b85f'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:39.830853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:39.834868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:39.838166 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:39.844502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:39.857806 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:39.880403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:39.884600 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:39.887802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:39.894393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:39.951638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44cc4960-8177-488d-8552-228d3d08ecca req-7c6576e5-1720-4606-9aa0-76d1344867ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:39.953337 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-44cc4960-8177-488d-8552-228d3d08ecca req-7c6576e5-1720-4606-9aa0-76d1344867ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0923798 May 25 15:44:39.972502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:39.978424 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:39.984679 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-50fabf1d-3391-4207-a1ad-50fae451493e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.002960 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-44cc4960-8177-488d-8552-228d3d08ecca req-0e9602d1-ed96-4dae-8f90-8323bd7dbe67 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431023 May 25 15:44:40.025033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a86a7244-7e4f-4df6-8ef2-406afb62650f,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.028234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.032672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.034561 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.2171829 May 25 15:44:40.037672 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46146) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.043477 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.050392 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.054911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.058183 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.066486 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.083807 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.157211 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.161815 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.163828 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.187200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bbad6e6-1a3a-4fc5-b449-0ec6356df21e,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.192921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.198860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.200134 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f85580a0-d682-4528-888c-38641c3cab9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1613867 May 25 15:44:40.203030 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46150) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.208525 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.214520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.219128 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.223065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.229391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.246014 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.310235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.313887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.315934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.337281 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=18fb8701-bada-4cd7-a997-d642cd177aea,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.339708 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.346438 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.347681 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1433172 May 25 15:44:40.350498 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46154) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.355518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.361130 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.365650 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.368840 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.374640 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.390205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.452127 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.456155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.459072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-39f964a5-3b91-4383-b2cc-bc8ada829754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.482694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=47e02c21-ea32-4dba-916f-b51b0b3ea4a9,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.485096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.492064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.493249 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1418345 May 25 15:44:40.495950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46158) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.500926 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.506401 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.510258 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.513493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.519683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.535664 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.600924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.604584 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.612011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-80e0a038-28e6-46d2-9569-2634c17325a3 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.630652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb78551a-666c-40ec-b9e1-a73a631ca92b,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.633705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.641656 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.643328 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1459594 May 25 15:44:40.646009 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46162) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.651657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.657668 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.662380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.665210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.671153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.683733 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.securitygroups_db [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Project 9276d22c6df545f2a056d5059899b85f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:44:40.689353 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.753328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.756693 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.758623 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.780652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d828f9e5-0b00-4768-9b38-25ca8fd2fb93,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.783012 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.789774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.791060 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-053d2f54-6051-4a3b-aaf3-c6f7a67e91c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1441057 May 25 15:44:40.793763 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46166) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:44:40.798727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'security_group_rule': {'security_group_id': 'a86a7244-7e4f-4df6-8ef2-406afb62650f', 'project_id': '9276d22c6df545f2a056d5059899b85f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:44:40.804209 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:44:40.807887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:security_group_rule and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:44:40.810814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:44:40.817200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:44:40.827269 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.securitygroups_db [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Project 9276d22c6df545f2a056d5059899b85f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 15:44:40.833831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.898913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.902213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.904118 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:40.925335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0ed9d46b-189d-4598-8434-ea6867a33dcb,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:40.927507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:40.934162 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:40.935302 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a199bddf-29d2-486c-b37f-eea254a75876 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1406391 May 25 15:44:41.197550 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 req-402e9df3-a75a-45ee-9457-e46c999f5167 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:41.198984 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 req-402e9df3-a75a-45ee-9457-e46c999f5167 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0833955 May 25 15:44:41.245059 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-19a99ba9-bf0e-4acd-b18c-28a1b22669f0 req-ca563c2e-9009-4442-86ad-3c30e06bf839 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400119 May 25 15:44:41.346432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 5f37aeac-39b6-49c9-aee9-e8ce768bb421 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:41.417939 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:41.422730 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:41.423111 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:41.546604 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:41.567066 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 5f37aeac-39b6-49c9-aee9-e8ce768bb421, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=5f37aeac-39b6-49c9-aee9-e8ce768bb421,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:41.569691 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:41.571678 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:41.638782 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=5f37aeac-39b6-49c9-aee9-e8ce768bb421,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:41.642013 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:42.435081 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 req-23993add-ecc3-4ff8-b7d6-97039ee19f21 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:42.436602 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 req-23993add-ecc3-4ff8-b7d6-97039ee19f21 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0848420 May 25 15:44:42.482730 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fe47e5df-9dd2-4f49-ac0b-894d200017d6 req-1714e176-54ab-4ded-8338-0838a58831ef tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403900 May 25 15:44:42.632701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:42.741535 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Sync routers for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:44:42.751512 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:42.752835 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:42.932465 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:43.255017 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '3653baa1-04ab-4037-9279-36fa2a5f66e1', 'name': '', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'mac_address': 'fa:16:3e:72:76:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:37Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 2, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'subnets': [{'id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:43.258942 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Checking router: 4af4a15f-6847-4985-8c5c-e2467f1831b2 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:44:43.259298 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Updating router 4af4a15f-6847-4985-8c5c-e2467f1831b2 port 3653baa1-04ab-4037-9279-36fa2a5f66e1 binding host dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 15:44:43.311592 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:43.325826 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 5f37aeac-39b6-49c9-aee9-e8ce768bb421 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:43.402043 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:43.402415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:43.683358 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f req-c4548ddd-fa9e-415b-b1d2-19682f161161 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:43.683937 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks [] for port, precommit_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:43.688338 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f req-c4548ddd-fa9e-415b-b1d2-19682f161161 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0897574 May 25 15:44:43.698062 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.provisioning_blocks [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Transition to ACTIVE for port object 3653baa1-04ab-4037-9279-36fa2a5f66e1 will not be triggered until provisioned by entity L2. {{(pid=98465) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:44:43.709232 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:43.715703 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:43.736082 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-22093a9b-17e5-43fc-bb05-ca0b2f0d1b4f req-5320d53f-f776-4ac3-87e7-e704c7cc6d58 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438275 May 25 15:44:43.877520 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d4d3a5-8a36-4ae4-b91c-8bc29d7f350a None None] Pushing event updated for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=3']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:43.880594 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-b2d4d3a5-8a36-4ae4-b91c-8bc29d7f350a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:43.942816 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Attempting to bind port 3653baa1-04ab-4037-9279-36fa2a5f66e1 on host dv-cinder-791239-3-iscsi for vnic_type normal with profile {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:44:43.943313 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Attempting to bind port 3653baa1-04ab-4037-9279-36fa2a5f66e1 by drivers openvswitch,hyperv on host dv-cinder-791239-3-iscsi at level 0 using segments [{'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:44:43.943829 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Attempting to bind port 3653baa1-04ab-4037-9279-36fa2a5f66e1 on network 89cbf153-f088-4f8c-8165-498b7d56e2fd {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:44:43.949549 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Checking agent: {'id': '9a495be1-4586-4a81-843d-031c30d54c9e', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-791239-3-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 32, 3), 'started_at': datetime.datetime(2021, 5, 25, 15, 32, 33), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 44, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-791239-3-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:44:43.950018 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Checking segment: {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98465) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:44:43.950422 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:43.950817 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Bound using segment: {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'} {{(pid=98465) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:44:43.951517 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.managers [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Bound port: 3653baa1-04ab-4037-9279-36fa2a5f66e1, host: dv-cinder-791239-3-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 355, 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd'}}] {{(pid=98465) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:44:43.951917 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:44.050530 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] For port 3653baa1-04ab-4037-9279-36fa2a5f66e1, host dv-cinder-791239-3-iscsi, cleared binding levels {{(pid=98465) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:44:44.053565 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.plugins.ml2.db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] For port 3653baa1-04ab-4037-9279-36fa2a5f66e1, host dv-cinder-791239-3-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=3653baa1-04ab-4037-9279-36fa2a5f66e1,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98465) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:44:44.062181 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron_lib.callbacks.manager [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98465) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:44.066356 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-1a088a14-95ee-45cc-b6df-1a842d3d75d6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:44.140430 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d4d3a5-8a36-4ae4-b91c-8bc29d7f350a None None] Pushing event updated for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=4']} {{(pid=98465) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:44.147341 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG oslo_concurrency.lockutils [None req-b2d4d3a5-8a36-4ae4-b91c-8bc29d7f350a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98465) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:44.148189 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:44:44.148720 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:44:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:44.341753 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:44:44.672022 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '3653baa1-04ab-4037-9279-36fa2a5f66e1', 'name': '', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'mac_address': 'fa:16:3e:72:76:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:37Z', 'updated_at': '2021-05-25T15:44:44Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'subnets': [{'id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:44:44.675915 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b8b7e24-7e34-495a-a48b-078212b26760 None None] The sync data for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi is: [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:44:38Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '3653baa1-04ab-4037-9279-36fa2a5f66e1', 'name': '', 'network_id': '89cbf153-f088-4f8c-8165-498b7d56e2fd', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'mac_address': 'fa:16:3e:72:76:47', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_interface', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:37Z', 'updated_at': '2021-05-25T15:44:44Z', 'revision_number': 4, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'subnets': [{'id': 'c1a27ea4-f8a7-4d92-acd2-417c203ea7b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:44:44.923740 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b req-3707675f-5c82-4f78-ba9e-b9d465c35824 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:44.925802 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b req-3707675f-5c82-4f78-ba9e-b9d465c35824 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0817528 May 25 15:44:44.974262 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f419d3b8-d310-4795-b6eb-e2f21e3b7c2b req-e92bdbeb-aebe-4d51-8c76-40603d35d96d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428739 May 25 15:44:45.377199 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3653baa1-04ab-4037-9279-36fa2a5f66e1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:45.407694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 req-07ea47f9-c0ad-45b0-98b9-12cc05829342 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:45.411310 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 req-07ea47f9-c0ad-45b0-98b9-12cc05829342 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1559999 May 25 15:44:45.456058 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:44:45.463685 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:45.464087 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:45.469657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-eeb22ebc-af2d-48d6-a042-ea9f1c7c9340 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:45.471488 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-eeb22ebc-af2d-48d6-a042-ea9f1c7c9340 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.1428204 May 25 15:44:45.476318 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-be5842cc-6bfd-4b64-bd53-5fd4548a39c7 req-1b4b5e66-003b-4d50-ac2d-66089c3c0e62 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0543175 May 25 15:44:45.605735 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:45.628962 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-028d9826-0d4e-4dd2-9201-9d1b6d6deb69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:45.631194 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-028d9826-0d4e-4dd2-9201-9d1b6d6deb69 service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.1526160 May 25 15:44:45.640177 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] For port 3653baa1-04ab-4037-9279-36fa2a5f66e1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=3653baa1-04ab-4037-9279-36fa2a5f66e1,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:44:45.644375 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:45.646268 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:44:45.738671 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Pushing event updated for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:44:45.744832 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:44:45.756579 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-3ffeba16-a404-43a8-b643-c7a55ab0cf2a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1001 time: 0.1123486 May 25 15:44:45.826345 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-b605438f-d5e9-4c82-9b4a-21a067559e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:45.827789 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-b605438f-d5e9-4c82-9b4a-21a067559e23 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0581863 May 25 15:44:45.912698 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-f175dc94-3778-4460-9206-6bff9342ef4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:45.914218 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-f175dc94-3778-4460-9206-6bff9342ef4f service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0771670 May 25 15:44:46.057338 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-df0a7817-6838-430b-b579-5d877451952b service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323204 May 25 15:44:46.292970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-accca0bb-4821-4fe8-8e2e-c709d3e77b40 req-06077d9b-ceb8-4b1c-8ccb-688249093d20 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2224767 May 25 15:44:46.681884 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e73feb4-37d3-4a03-be9b-9d07201058a6 req-ea6ac6ab-e4f9-4fd1-b13b-da73ff468b6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:46.688374 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2e73feb4-37d3-4a03-be9b-9d07201058a6 req-ea6ac6ab-e4f9-4fd1-b13b-da73ff468b6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0929132 May 25 15:44:46.728259 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2e73feb4-37d3-4a03-be9b-9d07201058a6 req-4f3e010c-8926-4db7-b720-9f784a6ac11f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375841 May 25 15:44:47.328470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3653baa1-04ab-4037-9279-36fa2a5f66e1 up at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:44:47.396577 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Provisioning complete for port 3653baa1-04ab-4037-9279-36fa2a5f66e1 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:44:47.396953 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:44:47.914795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 req-5fe7063b-f5de-4d9b-9bb9-38af7fb9297b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:47.916279 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 req-5fe7063b-f5de-4d9b-9bb9-38af7fb9297b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0799887 May 25 15:44:47.961091 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5e8b4481-bb94-4c6a-b1d0-9763d14be6e5 req-9c60980b-9561-45d1-87c4-d59afdea448d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389345 May 25 15:44:49.261859 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbce22e6-063f-46a6-ada7-31acf0cc3700 req-756c8f83-d8da-47fc-9858-922eff2a9e16 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:49.263728 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbce22e6-063f-46a6-ada7-31acf0cc3700 req-756c8f83-d8da-47fc-9858-922eff2a9e16 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1947508 May 25 15:44:49.310012 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cbce22e6-063f-46a6-ada7-31acf0cc3700 req-32869781-c394-4d79-9835-0d7c2cf2b136 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399718 May 25 15:44:50.557351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4fd888-21d9-41e3-91b6-959873f2ab95 req-82351f83-769f-444b-b835-39d732675900 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:50.558854 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4fd888-21d9-41e3-91b6-959873f2ab95 req-82351f83-769f-444b-b835-39d732675900 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.1414876 May 25 15:44:50.605402 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4fd888-21d9-41e3-91b6-959873f2ab95 req-338f4cc1-7ea9-41f3-a2bc-87d2ee38954b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408986 May 25 15:44:51.789962 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5588bfb0-fff5-4c54-94c9-6f86756ac35c req-0681120e-6f5d-4a80-a96c-e43635d0b20b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:44:51.791453 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5588bfb0-fff5-4c54-94c9-6f86756ac35c req-0681120e-6f5d-4a80-a96c-e43635d0b20b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0796111 May 25 15:44:51.838929 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5588bfb0-fff5-4c54-94c9-6f86756ac35c req-fc6a5bc2-b8c3-4665-b116-bd6bd316501c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416975 May 25 15:44:59.971705 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-65786b37-5322-4b22-8fcf-fcda44df796d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:01.673519 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:45:02.619760 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46434) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:02.629055 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.673797 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-79e2d7b2-3fdf-48d5-81fa-a50998776bbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.738905 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.753610 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:02.757429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Usage tracker for resource:security_group_rule and tenant:07b4bc0d72784be184d016a8ca1c6a38 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:02.760266 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:02.766164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:02.847690 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.851429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.859477 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cb7fe500-685c-4f5d-9847-05b0d213b6ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:02.900537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=07b4bc0d72784be184d016a8ca1c6a38&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2772744 May 25 15:45:02.900537 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93e9dd27-1040-4176-9568-d248f3e6aa57,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:02.900953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46440) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:02.907362 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.907734 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.908118 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.909033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.909378 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.909722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.910061 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.910400 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.910740 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.911077 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.911412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.911743 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:02.915593 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:02.958836 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:02.984198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.036221 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.039767 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-fff53624-89e7-4f3e-a280-1797c5d2355a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:03.050824 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93e9dd27-1040-4176-9568-d248f3e6aa57,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:03.060733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.061110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.061482 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.061868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.062234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.062595 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.062951 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.063305 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.063662 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.064046 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.064405 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.064754 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:03.067716 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.068825 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/93e9dd27-1040-4176-9568-d248f3e6aa57 HTTP/1.1" status: 204 len: 168 time: 0.1668618 May 25 15:45:03.069738 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:03.344175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46450) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:03.362012 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.376716 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:03.381030 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Usage tracker for resource:security_group_rule and tenant:672b2102609648e8beaec8d4fe550b1c is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:03.383956 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:03.389903 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:03.445425 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.470236 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.473644 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.484917 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6e939b21-0f9f-4da1-91d8-5c5d77c06238 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:03.524282 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=672b2102609648e8beaec8d4fe550b1c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1789870 May 25 15:45:03.525111 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c39e1032-cd83-42b8-8734-21372cbbe5bd,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:03.526931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46454) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:03.528086 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:03.589299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.615742 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.671975 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.676071 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a37423d8-d438-4623-9bfe-2943178a3184 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:03.688406 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c39e1032-cd83-42b8-8734-21372cbbe5bd,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:03.692700 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:03.697869 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:03.698961 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c000fc67-ad20-4c41-ada6-a4d9331b535b admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c39e1032-cd83-42b8-8734-21372cbbe5bd HTTP/1.1" status: 204 len: 168 time: 0.1704707 May 25 15:45:05.164302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.379592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46502) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:05.495288 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.509994 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:05.514033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Usage tracker for resource:security_group_rule and tenant:e52722cab17a4a36832070e917d74e46 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:05.516792 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:05.522401 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:05.605466 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.609207 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.616725 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f93918a2-e30b-4a21-a529-6971a13c7a66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:05.656673 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=e52722cab17a4a36832070e917d74e46&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2759612 May 25 15:45:05.657528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=903699c0-1bd0-4360-aefe-05792212de75,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:05.659907 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46510) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:05.661624 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:05.718373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.744487 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.798155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.802308 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ac8d6f51-23f1-4b2a-81ec-fd6ea099f936 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:05.812955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=903699c0-1bd0-4360-aefe-05792212de75,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:05.817021 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:05.820406 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:05.821789 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-cd3b2610-c2cb-488c-b64a-00ad249c864e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/903699c0-1bd0-4360-aefe-05792212de75 HTTP/1.1" status: 204 len: 168 time: 0.1608808 May 25 15:45:06.094140 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46518) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:06.111757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.125728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:06.129489 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Usage tracker for resource:security_group_rule and tenant:950c5775036648ad8fceb58560605a4e is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:06.132324 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:06.138287 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:06.217972 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.222076 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.228878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:06.266877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b56f89a-f4da-4494-90af-5df251340cc9,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:06.271474 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=950c5775036648ad8fceb58560605a4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1763422 May 25 15:45:06.272406 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:06.274116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46522) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:06.334574 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.362969 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.414600 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.418215 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aa431ac3-b29b-407d-a446-75c0f596fbc4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:06.428709 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b56f89a-f4da-4494-90af-5df251340cc9,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:06.430903 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:06.435745 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:06.436882 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/8b56f89a-f4da-4494-90af-5df251340cc9 HTTP/1.1" status: 204 len: 168 time: 0.1618345 May 25 15:45:07.910617 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-433a05c0-5f65-4160-a1f5-c4c4a231d67e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:security_group {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:07.927039 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-433a05c0-5f65-4160-a1f5-c4c4a231d67e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:security_group {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:07.928461 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-433a05c0-5f65-4160-a1f5-c4c4a231d67e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-833018644&fields=id&tenant_id=9276d22c6df545f2a056d5059899b85f HTTP/1.1" status: 200 len: 267 time: 0.0578451 May 25 15:45:08.081695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-5fbdc83b-e339-405f-af3f-89786cf73c8b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:08.082327 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-5fbdc83b-e339-405f-af3f-89786cf73c8b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:network {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:08.099736 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-5fbdc83b-e339-405f-af3f-89786cf73c8b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:network {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:08.100970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-5fbdc83b-e339-405f-af3f-89786cf73c8b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 809 time: 0.1656406 May 25 15:45:08.115663 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-bd4caf6a-7589-4597-aa09-fe19dd0fa754 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/quotas/9276d22c6df545f2a056d5059899b85f HTTP/1.1" status: 200 len: 375 time: 0.0089300 May 25 15:45:08.197863 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-3c285d55-1802-4257-9556-a3238ba2273f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:08.214740 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-3c285d55-1802-4257-9556-a3238ba2273f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:08.216201 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-3c285d55-1802-4257-9556-a3238ba2273f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0955186 May 25 15:45:08.373569 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-6373413e-ffbc-4cc0-bfbf-7656ba2775bf service neutron] 10.222.0.36 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1457050 May 25 15:45:08.514233 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-0e8aee10-640a-4995-96b7-6aec3602a5d1 service neutron] 10.222.0.36 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328225 May 25 15:45:08.967428 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-76577164-fead-47cd-9ea3-89abc8b2757c req-cd6b5b64-4ad2-4df1-83d8-e4aae6745f3a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0488479 May 25 15:45:09.981549 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-ccd73d82-dda6-4f63-b78e-0d55827e822a service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1710815 May 25 15:45:10.163250 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0f651315-4e2b-473e-a276-654c305ba2b5 req-f5ccb111-9900-4a12-839d-189eb6e43387 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0870111 May 25 15:45:10.185356 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-68472544-59ad-4513-82de-5ebadbc818f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:10.186867 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-68472544-59ad-4513-82de-5ebadbc818f0 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 1098 time: 0.1119826 May 25 15:45:10.530500 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-d904f272-93c2-4570-b5dd-c075329d334c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:10.531979 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-d904f272-93c2-4570-b5dd-c075329d334c service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.3101499 May 25 15:45:10.657591 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-9ad25e65-cfc5-42a3-92c2-104eaca9528f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:10.659566 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-9ad25e65-cfc5-42a3-92c2-104eaca9528f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 809 time: 0.2656231 May 25 15:45:10.675532 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-10960a1c-62a2-45b2-aca1-1fb1a582bd37 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 200 len: 1001 time: 0.1264100 May 25 15:45:10.763056 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-bcb1de2f-4d15-41cb-a39b-c52caf7ab7ba tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9276d22c6df545f2a056d5059899b85f HTTP/1.1" status: 200 len: 379 time: 0.0856090 May 25 15:45:10.770952 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-ad05fae1-c55a-426c-9011-7437f65fd2c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:10.772384 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-ad05fae1-c55a-426c-9011-7437f65fd2c5 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0807521 May 25 15:45:10.776779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'port': {'device_id': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'admin_state_up': True, 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'security_groups': ['a86a7244-7e4f-4df6-8ef2-406afb62650f']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:10.969532 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:10.973161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-cc962bec-58bd-4e0f-be38-f7f7c47f0de9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:10.974669 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-cc962bec-58bd-4e0f-be38-f7f7c47f0de9 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1817119 May 25 15:45:10.982939 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:11.009644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Made reservation on behalf of 9276d22c6df545f2a056d5059899b85f for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:45:11.013214 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.198874 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-b88a400c-ec15-44cd-8a5c-0c1c1a14238c service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2096088 May 25 15:45:11.312881 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f97a2cbd-84c1-4a3d-ad55-61e395232533 req-d262bb76-4b56-4328-add8-ed084b62a863 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0430498 May 25 15:45:11.348579 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Allocated IP 172.20.0.12 (bef3b39e-4efb-47b6-ab09-ddc4c406ab32/ce334cf7-ad8f-4d17-8efa-939b870abd6d/7ae06ec7-6469-494a-b223-ce3de0a0e2da) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:45:11.403970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d6f7f5ef-474d-4c07-bbb2-5ecabe41f915 req-39d00b61-733a-447d-bce8-c78ef0d76064 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1720886 May 25 15:45:11.570320 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.585210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Transition to ACTIVE for port object 7ae06ec7-6469-494a-b223-ce3de0a0e2da will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:45:11.608358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.614701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-989b4ec7-c723-400a-88b8-76f914e3c6da tempest-VolumesNegativeTest-1590109032 tempest-VolumesNegativeTest-1590109032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:11.685203 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:45:11.688312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:45:11.692189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:45:11.748855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:11.761358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:11.762038 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.766407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:11.794902 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0215254 May 25 15:45:11.813450 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Request body: {'port': {'device_id': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:11.920670 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-1a323544-bad5-4335-bf27-0985a046a71e None None] Provisioning for port 7ae06ec7-6469-494a-b223-ce3de0a0e2da completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:45:11.926615 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-1a323544-bad5-4335-bf27-0985a046a71e None None] Provisioning complete for port 7ae06ec7-6469-494a-b223-ce3de0a0e2da triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:45:11.927164 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1a323544-bad5-4335-bf27-0985a046a71e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.934243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:11.987508 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-1a323544-bad5-4335-bf27-0985a046a71e None None] Port 7ae06ec7-6469-494a-b223-ce3de0a0e2da cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:45:12.396795 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7ae06ec7-6469-494a-b223-ce3de0a0e2da {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:45:12.404619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.419413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Transition to ACTIVE for port object 7ae06ec7-6469-494a-b223-ce3de0a0e2da will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:45:12.455873 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.464808 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:12.641815 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.647061 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:12.675507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:12.734781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 req-45dd8446-1413-4259-bf30-e9a7e4741f4f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:12.735484 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 req-45dd8446-1413-4259-bf30-e9a7e4741f4f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:12.742783 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Attempting to bind port 7ae06ec7-6469-494a-b223-ce3de0a0e2da on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:45:12.743119 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Attempting to bind port 7ae06ec7-6469-494a-b223-ce3de0a0e2da by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:45:12.743446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Attempting to bind port 7ae06ec7-6469-494a-b223-ce3de0a0e2da on network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:45:12.750697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Port 7ae06ec7-6469-494a-b223-ce3de0a0e2da on network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:45:12.751015 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Attempting to bind port 7ae06ec7-6469-494a-b223-ce3de0a0e2da on network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:45:12.761221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 45, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:45:12.761591 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Checking segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:45:12.761979 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Bound using segment: {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:45:12.762699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Bound port: 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bb2550ff-05c6-4e65-a727-67a511075e2d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 358, 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:45:12.763092 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.773981 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 req-45dd8446-1413-4259-bf30-e9a7e4741f4f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:12.775119 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 req-45dd8446-1413-4259-bf30-e9a7e4741f4f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.3540788 May 25 15:45:12.876599 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb269ed9-41d9-40b5-9d54-c930a8ccc4c9 req-bac88f52-acc6-44f2-a45c-9732ddc29068 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0946610 May 25 15:45:12.888409 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:45:12.899612 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:45:12.904052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.908086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5e83266c-4808-4cf4-aea8-3046a0de9a6a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:12.966571 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:12.967201 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:12.968668 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] 10.222.0.70 "PUT /v2.0/ports/7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1094 time: 1.1596918 May 25 15:45:12.971197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:12.995793 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:12.999149 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:13.029145 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'status': 'completed', 'code': 200} May 25 15:45:13.115027 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-7dd3a64d-1791-43d3-b4d0-7febcb428354 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:13.116677 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-7dd3a64d-1791-43d3-b4d0-7febcb428354 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1097 time: 0.0762024 May 25 15:45:13.197717 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-6c978bb1-63e5-4428-91b0-6422cf07647a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 217 time: 0.0646193 May 25 15:45:13.262811 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-dc43af98-caa3-46ad-a66e-ac920391e599 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:13.264326 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-dc43af98-caa3-46ad-a66e-ac920391e599 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0573664 May 25 15:45:13.345307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-b86f09a6-de8f-4eb6-b86e-8712907ed70a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:13.347271 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-b86f09a6-de8f-4eb6-b86e-8712907ed70a service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0753546 May 25 15:45:13.493841 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-09cbd68f-dbbc-4f3c-bddb-9552d7cf9db3 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1298687 May 25 15:45:13.644876 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ee6f97e1-a583-4299-8d9c-b54f2cc5e6f6 req-6d16dad6-c930-4858-9d3e-a6e0f30be1dc service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279621 May 25 15:45:13.827456 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d767b38b-34dc-42d5-b689-40976a664e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:13.829025 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-d767b38b-34dc-42d5-b689-40976a664e23 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1097 time: 0.0756631 May 25 15:45:13.969661 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-a2c5dd97-a654-43b1-8199-46d22ade0190 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:13.971522 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-a2c5dd97-a654-43b1-8199-46d22ade0190 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.1327310 May 25 15:45:14.183793 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-625ce47b-49fc-4d9b-a2de-2bfbb57b5ab0 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 217 time: 0.1928699 May 25 15:45:14.263794 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-c412673c-2514-4c2b-83ad-1c55a3984e46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:14.265266 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-c412673c-2514-4c2b-83ad-1c55a3984e46 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0693765 May 25 15:45:14.277465 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0659fa5a-9983-4132-8933-72c8efc21a13 req-22fc9fef-3a0f-4929-8eaa-c3004e93e73a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:14.279058 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0659fa5a-9983-4132-8933-72c8efc21a13 req-22fc9fef-3a0f-4929-8eaa-c3004e93e73a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.2895930 May 25 15:45:14.372083 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0659fa5a-9983-4132-8933-72c8efc21a13 req-0a0f959b-499f-4e1c-a7d7-810b738726de tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0620525 May 25 15:45:14.385867 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-fbb43b3c-44e7-46ad-a4de-999d1572871c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:14.387601 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-fbb43b3c-44e7-46ad-a4de-999d1572871c service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1074474 May 25 15:45:14.527249 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-7620e740-93c2-40e1-bff1-d014b91e36e3 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1315389 May 25 15:45:14.660882 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcd4d6d5-f754-4e6f-b6b7-6b0cdb417ea7 req-397ad12b-9921-420e-8791-57cdfe82f058 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1244154 May 25 15:45:15.555447 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-782a0cbe-2686-40f5-9c19-f859448f8184 req-97d9d8d2-abe7-450f-80f7-e1aab2738d87 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:15.556929 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-782a0cbe-2686-40f5-9c19-f859448f8184 req-97d9d8d2-abe7-450f-80f7-e1aab2738d87 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0788167 May 25 15:45:15.604515 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-782a0cbe-2686-40f5-9c19-f859448f8184 req-2eb6db74-c332-4a63-9082-f805ab87c405 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:15.615881 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-782a0cbe-2686-40f5-9c19-f859448f8184 req-2eb6db74-c332-4a63-9082-f805ab87c405 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:15.616994 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-782a0cbe-2686-40f5-9c19-f859448f8184 req-2eb6db74-c332-4a63-9082-f805ab87c405 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545032 May 25 15:45:16.360106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46712) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:16.485035 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.503521 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:16.507371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Usage tracker for resource:security_group_rule and tenant:106b53fae24c4d969f3a99b2b0a07c9f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:16.510281 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:16.516253 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:16.598804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.602544 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.610548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d765406-a52b-4e82-80bd-a55dab1fc159 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:16.648597 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=106b53fae24c4d969f3a99b2b0a07c9f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2873437 May 25 15:45:16.650197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cbfabc82-27e2-411c-a0e5-7755f02b4986,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:16.651536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46720) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:16.661104 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:16.711998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.737822 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.790661 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.795316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bf257417-b4c1-456c-8231-5a21aa68db3e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:16.802244 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca70fe4-c422-4e91-a629-b2a4932b9b03 req-62baf550-d966-445a-96ff-15cc9215a935 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:16.803738 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fca70fe4-c422-4e91-a629-b2a4932b9b03 req-62baf550-d966-445a-96ff-15cc9215a935 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0797954 May 25 15:45:16.809624 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbfabc82-27e2-411c-a0e5-7755f02b4986,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:16.812168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:16.823756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:16.827702 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/cbfabc82-27e2-411c-a0e5-7755f02b4986 HTTP/1.1" status: 204 len: 168 time: 0.1751487 May 25 15:45:16.863910 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fca70fe4-c422-4e91-a629-b2a4932b9b03 req-91444706-ffe0-4223-bf56-424714b09a5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512455 May 25 15:45:17.100589 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46728) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:17.119210 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.133074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:17.136848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Usage tracker for resource:security_group_rule and tenant:9b9ecc1907a24f6d91b8a979b28f7aa1 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:17.139841 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:17.145944 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:17.226304 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.230059 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.241299 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5b63dba4-2e4b-44e4-a1df-6557e4de136e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:17.278152 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c431fc20-e9a7-4f90-a7e6-baf3de427df2,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:17.282235 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=9b9ecc1907a24f6d91b8a979b28f7aa1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1806767 May 25 15:45:17.283769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5f2c6587-1657-45e7-8c1b-0d9697fb8d36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:17.285528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46732) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:17.341025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.366053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.418412 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.422029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9c6c1846-87a1-4a83-ac4c-541cf7d7851a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:17.432420 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c431fc20-e9a7-4f90-a7e6-baf3de427df2,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:17.436129 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:17.439186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.440337 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c431fc20-e9a7-4f90-a7e6-baf3de427df2 HTTP/1.1" status: 204 len: 168 time: 0.1539357 May 25 15:45:17.778873 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46740) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:17.795967 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.809557 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:17.814124 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Usage tracker for resource:security_group_rule and tenant:dcea0678dbd84734b0b5480671ea722e is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:17.817036 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:17.822663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:17.910056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.913928 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:17.922303 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54030e16-998b-4bac-932c-3ac480cc3049 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:17.961490 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=dcea0678dbd84734b0b5480671ea722e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1814046 May 25 15:45:17.962935 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a04b61bd-118e-4a44-801f-01ff8da03a9d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:17.964344 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 46746) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:17.966217 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:18.024360 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:18.051532 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:18.062223 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84358249-a85c-4087-b742-bd62e49ffc5b req-c43ab481-03f6-4807-b0fc-f15ae04ed857 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:18.063691 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-84358249-a85c-4087-b742-bd62e49ffc5b req-c43ab481-03f6-4807-b0fc-f15ae04ed857 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0797570 May 25 15:45:18.105452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:18.109610 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-84358249-a85c-4087-b742-bd62e49ffc5b req-c43fb481-e158-4ec4-a8b6-b0ac11809230 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0398204 May 25 15:45:18.111953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:18.124238 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a04b61bd-118e-4a44-801f-01ff8da03a9d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:18.132590 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:18.133695 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/a04b61bd-118e-4a44-801f-01ff8da03a9d HTTP/1.1" status: 204 len: 168 time: 0.1673620 May 25 15:45:18.134652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:18.773647 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-4d487727-1867-44c2-9d70-5ed412854204 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-322049059&fields=id&tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6 HTTP/1.1" status: 200 len: 267 time: 0.0412269 May 25 15:45:18.862286 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-a6d5cc90-6fcf-42b7-8057-722ff88befb1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:18.863742 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-a6d5cc90-6fcf-42b7-8057-722ff88befb1 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 984 time: 0.0845606 May 25 15:45:18.874785 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Request body: {'port': {'security_groups': ['f277e78b-c576-4ffa-b9c2-0ae2856bc3cc']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:18.996545 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.249375 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:19.276090 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.283739 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.290175 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a7f4e8a6-6b53-4b35-808f-5245e9f46369 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:19.302390 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:45:19.362283 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:19.363011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.364502 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-29cb020e-2bf4-4e2f-9d57-3b75583e7a85 req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "PUT /v2.0/ports/c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 942 time: 0.4943845 May 25 15:45:19.365069 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:19.370469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46792) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:19.386625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event updated for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=7']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:19.400628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:19.456896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb5493e8-6443-4958-bd14-6efa67fc81a0 req-3c7fb4ef-cadd-4ad3-9fb5-e2e8bbde2fb0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:19.464649 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb5493e8-6443-4958-bd14-6efa67fc81a0 req-3c7fb4ef-cadd-4ad3-9fb5-e2e8bbde2fb0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.2427778 May 25 15:45:19.480015 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:45:19.527602 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.581872 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb5493e8-6443-4958-bd14-6efa67fc81a0 req-d2d6a0b2-1a7f-42c2-823b-5fa67792f6c9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1162362 May 25 15:45:19.604689 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.604856 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:45:19.618853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-f5566ff9-16c1-42db-9e9d-ffcfcb8e29ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:19.620394 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-f5566ff9-16c1-42db-9e9d-ffcfcb8e29ff service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1098 time: 0.1065993 May 25 15:45:19.690249 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.698772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6fa887c2-ba85-450e-ad42-ba3456076d9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:19.718364 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=17501c6a-8302-4871-b31d-a8c482336d39,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:19.725490 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-eea7b01c-b9c7-480c-b163-aca94bd44c83 None None] Provisioning complete for port c536b9e5-ae17-4775-b209-71e6ec42122a triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:45:19.725719 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-eea7b01c-b9c7-480c-b163-aca94bd44c83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.729861 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:19.752406 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:19.754021 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /v2.0/security-groups/17501c6a-8302-4871-b31d-a8c482336d39 HTTP/1.1" status: 204 len: 168 time: 0.3820100 May 25 15:45:19.756858 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46804) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:19.793564 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-be5f496c-32e9-475f-bcee-40993ab367c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:19.796631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-be5f496c-32e9-475f-bcee-40993ab367c3 service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.1562853 May 25 15:45:20.019125 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-41606403-3770-4af8-ad7a-9b0420c3a3a6 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 1000 time: 0.2087781 May 25 15:45:20.102306 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Deleting port 32450a42-190a-4cf4-bf2d-3860fafab442 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:20.102638 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:20.109909 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-03e0d03d-7ea4-432a-bb59-77575edd2bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:20.111517 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-03e0d03d-7ea4-432a-bb59-77575edd2bb6 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0726275 May 25 15:45:20.203337 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-237224f2-e2ad-48b9-adb5-3b41715982bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:20.204865 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-237224f2-e2ad-48b9-adb5-3b41715982bd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0779276 May 25 15:45:20.223218 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:20.223547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:20.350164 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-0f699011-b419-4701-a16b-03c133904f03 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263905 May 25 15:45:20.351468 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling delete_port for 32450a42-190a-4cf4-bf2d-3860fafab442 owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:20.505483 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-87521135-a3c1-428b-92a1-029ed4453fd6 req-4a37ebcf-3fac-4e27-8e5b-8043b3d3b376 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1351933 May 25 15:45:20.565486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:20.569214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cb66c841-7b46-4a61-ba55-44b69cf44200 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:20.614529 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event deleted for resources: {'Port': ['ID=32450a42-190a-4cf4-bf2d-3860fafab442,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:20.618530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:20.724597 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:20.724935 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Floating IP 1a4342da-ab04-4564-8557-72bc8ff2e735 disassociated (deleted). External IP: 172.27.0.74, port: c536b9e5-ae17-4775-b209-71e6ec42122a. May 25 15:45:20.799273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-106b029f-24ec-4509-a883-b4101d8830db req-6ce66a80-10e6-493c-85d2-6e55ed367937 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:20.800797 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-106b029f-24ec-4509-a883-b4101d8830db req-6ce66a80-10e6-493c-85d2-6e55ed367937 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0997658 May 25 15:45:20.850983 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-106b029f-24ec-4509-a883-b4101d8830db req-4eaa07f2-0fa3-402c-83fe-dfbe16c07ba7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442984 May 25 15:45:20.860744 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:45:21.025192 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:21.039364 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'mac_address': 'fa:16:3e:ff:d2:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:45:21.099178 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:21.117930 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ae06ec7-6469-494a-b223-ce3de0a0e2da {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:45:21.136738 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:21.140753 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:21.143131 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:21.195607 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Router 39dd6c05-7a84-4acc-a23b-40de52e09655 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:21.207697 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:21.210835 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:21.380453 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:21.389740 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Sync routers for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:21.400069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:21.400366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:21.400692 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:21.453084 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-fa6d8de0-afb6-4a98-a137-b55afeb53042 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "DELETE /v2.0/floatingips/1a4342da-ab04-4564-8557-72bc8ff2e735 HTTP/1.1" status: 204 len: 168 time: 1.6952198 May 25 15:45:21.453735 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:21.586176 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:21.629666 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['7ae06ec7-6469-494a-b223-ce3de0a0e2da'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:45:21.634083 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:45:21.738331 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-0b1370a0-9a77-4e63-a879-4fec671c739f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:21.739938 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-0b1370a0-9a77-4e63-a879-4fec671c739f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 1098 time: 0.0731952 May 25 15:45:21.965188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-bbbb6d91-5472-4b5d-b53b-da2181f03823 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:21.966654 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-bbbb6d91-5472-4b5d-b53b-da2181f03823 service neutron] 10.222.0.70 "GET /v2.0/networks?id=07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 200 len: 916 time: 0.2113380 May 25 15:45:22.054701 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-a6d07766-8f19-4d0b-854b-7a86de0a6df0 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 200 len: 217 time: 0.0750973 May 25 15:45:22.124689 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1640974f-004c-489f-ace7-ea8beee66359 req-f427abd4-e102-41b7-a77c-2f3da2a291da tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:22.128498 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1640974f-004c-489f-ace7-ea8beee66359 req-f427abd4-e102-41b7-a77c-2f3da2a291da tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 945 time: 0.1121681 May 25 15:45:22.147622 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-a82e049a-8ae6-4bed-975f-8debce0635e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:22.149566 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-a82e049a-8ae6-4bed-975f-8debce0635e1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 200 len: 854 time: 0.0839479 May 25 15:45:22.153267 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:22.161392 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Checking router: 39dd6c05-7a84-4acc-a23b-40de52e09655 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:22.199186 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1640974f-004c-489f-ace7-ea8beee66359 req-5c9dafea-2489-4720-83cb-b24e44eb99dd tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0595782 May 25 15:45:22.216925 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:22.217753 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:22.252989 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-8b4e1128-0b0d-48c6-963e-696db7340d9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:22.254731 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-8b4e1128-0b0d-48c6-963e-696db7340d9b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=07e4e701-ccf8-451e-b3d9-a809a6936fed&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0957294 May 25 15:45:22.400272 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-b7e9b281-4d60-4499-87f7-a7a1a7ebcc20 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1364090 May 25 15:45:22.435949 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:22.558050 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-584747ce-aa3a-4946-8cad-802b11f0e21c req-569772c0-7c18-4f2e-8f87-51c647c11f02 service neutron] 10.222.0.70 "GET /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1358383 May 25 15:45:22.817172 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:22.825518 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3d673efb-09ff-4a90-a628-eaec918e081b None None] The sync data for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi is: [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:40:54Z', 'revision_number': 4, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '85083215-6cfc-4d24-9e98-c780cae18089', 'name': '', 'network_id': '07e4e701-ccf8-451e-b3d9-a809a6936fed', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'mac_address': 'fa:16:3e:24:85:33', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_interface', 'standard_attr_id': 230, 'fixed_ips': [{'subnet_id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:52Z', 'updated_at': '2021-05-25T15:41:01Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'subnets': [{'id': '79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:23.107464 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4298fb20-757f-47b8-92cf-fd2bd2f01776 None None] New status for floating IP 1a4342da-ab04-4564-8557-72bc8ff2e735: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:45:23.404947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b669777-d873-4c0c-9a19-a257e77eb9a5 req-bca45cc2-6989-4d2f-b443-6bf6ae49ae61 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:23.406427 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b669777-d873-4c0c-9a19-a257e77eb9a5 req-bca45cc2-6989-4d2f-b443-6bf6ae49ae61 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 945 time: 0.0927544 May 25 15:45:23.453681 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b669777-d873-4c0c-9a19-a257e77eb9a5 req-11721cd5-7b42-49f4-a7e5-a4b182462ceb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0408013 May 25 15:45:24.662253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90de1846-2157-4407-9f72-7f0994e9c5f6 req-29d23d38-aab4-4d1f-8ff4-22ab3a4d7a8f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:24.663774 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-90de1846-2157-4407-9f72-7f0994e9c5f6 req-29d23d38-aab4-4d1f-8ff4-22ab3a4d7a8f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 945 time: 0.0881619 May 25 15:45:24.713580 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-90de1846-2157-4407-9f72-7f0994e9c5f6 req-5852d3ce-7b46-4276-aea1-49e28398ac90 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437407 May 25 15:45:24.879409 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:45:24.960024 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 7ae06ec7-6469-494a-b223-ce3de0a0e2da completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:45:24.966194 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 7ae06ec7-6469-494a-b223-ce3de0a0e2da triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:45:24.966609 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:25.095122 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:25.122299 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:25.133349 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:25.138018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:25.141578 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:25.159453 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e req-3e967924-09f2-4372-bf2e-79441d8df212 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:25.161040 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e req-3e967924-09f2-4372-bf2e-79441d8df212 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.0887620 May 25 15:45:25.178720 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'code': 200} May 25 15:45:25.211123 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-88bc2407-ef73-4e0a-8bfd-7ee980d3922e req-8931c5e4-3cf8-44ee-8730-7ba66486f7eb tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430107 May 25 15:45:25.219303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:25.222497 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:25.525767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aca1241-0561-4f4f-a86e-5e7833ce0127 req-b45f26c5-5924-43ce-89e6-d6d86f4fc74f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:25.527274 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5aca1241-0561-4f4f-a86e-5e7833ce0127 req-b45f26c5-5924-43ce-89e6-d6d86f4fc74f service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.0764337 May 25 15:45:25.575094 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5aca1241-0561-4f4f-a86e-5e7833ce0127 req-add42ceb-8f7e-4d13-86d4-225d7f651863 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0351489 May 25 15:45:25.895474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f54488-6052-4455-8e3f-f72b752f6757 req-5f67ea7e-4187-4ff8-9bab-65e27acc2d6f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:25.896197 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-47f54488-6052-4455-8e3f-f72b752f6757 req-5f67ea7e-4187-4ff8-9bab-65e27acc2d6f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:25.902973 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca req-b3fa67cf-c044-41c7-b56a-c10c18d6ca62 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:25.904465 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca req-b3fa67cf-c044-41c7-b56a-c10c18d6ca62 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0795572 May 25 15:45:25.912743 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-47f54488-6052-4455-8e3f-f72b752f6757 req-5f67ea7e-4187-4ff8-9bab-65e27acc2d6f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:25.913873 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-47f54488-6052-4455-8e3f-f72b752f6757 req-5f67ea7e-4187-4ff8-9bab-65e27acc2d6f tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.0997949 May 25 15:45:25.953002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f52ec04d-c74c-494b-997e-6f8cc84ac0ca req-0e87bd00-c6af-4614-9f23-95f01f4bcd06 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422661 May 25 15:45:25.957173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-47f54488-6052-4455-8e3f-f72b752f6757 req-31152277-2ce0-42ab-982e-8666b55069cf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Synchronizing usage tracker for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:25.972773 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-47f54488-6052-4455-8e3f-f72b752f6757 req-31152277-2ce0-42ab-982e-8666b55069cf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Unset dirty status for tenant:55dc60a2768e4d2db35d44c21ff0e0a6 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:25.973951 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-47f54488-6052-4455-8e3f-f72b752f6757 req-31152277-2ce0-42ab-982e-8666b55069cf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544291 May 25 15:45:26.403066 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 req-c64ce66c-a9d8-4c18-9c5e-a26cb65675c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:26.404578 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 req-c64ce66c-a9d8-4c18-9c5e-a26cb65675c0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.0846634 May 25 15:45:26.449315 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6cccf4e6-9939-44e0-a8d7-bda9091107c5 req-b2f3cde1-7d2e-49d1-9c7f-1a2a8bf2f71a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386558 May 25 15:45:27.144029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57fe15bb-ca86-4b30-8317-241f87ab8589 req-1f527191-9215-499b-8d63-73ce7b7bc5b6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.145464 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-57fe15bb-ca86-4b30-8317-241f87ab8589 req-1f527191-9215-499b-8d63-73ce7b7bc5b6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0864229 May 25 15:45:27.192316 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-57fe15bb-ca86-4b30-8317-241f87ab8589 req-82e60cc3-b522-49e6-9ff2-35ca97277f3b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409424 May 25 15:45:27.260956 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b20f9092-0a37-45a8-8375-588281b5457d req-0d7ceb39-ca35-4ef9-80e1-cfaecea0c6fc tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.262429 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b20f9092-0a37-45a8-8375-588281b5457d req-0d7ceb39-ca35-4ef9-80e1-cfaecea0c6fc tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.1785688 May 25 15:45:27.308401 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b20f9092-0a37-45a8-8375-588281b5457d req-d63bb38c-e699-4f51-a1af-572a57ec4e0e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402603 May 25 15:45:27.374225 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eeefb21-f0de-4db9-aac3-661613b18602 req-84e54260-d73c-452d-957e-83c599f5473d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.375672 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eeefb21-f0de-4db9-aac3-661613b18602 req-84e54260-d73c-452d-957e-83c599f5473d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0787094 May 25 15:45:27.419360 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9eeefb21-f0de-4db9-aac3-661613b18602 req-110f58e6-1740-45c7-b139-e7f2878c7fd5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378528 May 25 15:45:27.442461 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46948) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:27.678475 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-16fae2a0-b81f-4c2d-8add-6128d7ea580b tempest-TestShelveInstance-1012594275 tempest-TestShelveInstance-1012594275-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.679107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-16fae2a0-b81f-4c2d-8add-6128d7ea580b tempest-TestShelveInstance-1012594275 tempest-TestShelveInstance-1012594275-project-admin] Synchronizing usage tracker for tenant:4d92794aeb894cfd99077fb5ebd9b29e on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:27.696551 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d753fcc-c48f-423a-8292-ff6b26add01a req-22b8cfb5-ee17-43ed-b9b5-b91f98576300 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.698266 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d753fcc-c48f-423a-8292-ff6b26add01a req-22b8cfb5-ee17-43ed-b9b5-b91f98576300 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.1392412 May 25 15:45:27.703489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-16fae2a0-b81f-4c2d-8add-6128d7ea580b tempest-TestShelveInstance-1012594275 tempest-TestShelveInstance-1012594275-project-admin] Unset dirty status for tenant:4d92794aeb894cfd99077fb5ebd9b29e on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:27.708320 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-16fae2a0-b81f-4c2d-8add-6128d7ea580b tempest-TestShelveInstance-1012594275 tempest-TestShelveInstance-1012594275-project-admin] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1094 time: 0.2648685 May 25 15:45:27.709314 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46960) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:27.714577 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'fixed_ip_address': '172.20.0.12'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:27.722272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:27.726923 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Usage tracker for resource:floatingip and tenant:9276d22c6df545f2a056d5059899b85f is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:27.729911 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:27.736009 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:27.752347 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for floatingip, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:27.754699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-2935667f-a26d-428d-8e09-f2c710323ca3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:27.756196 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-2935667f-a26d-428d-8e09-f2c710323ca3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 947 time: 0.1344407 May 25 15:45:27.763648 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d753fcc-c48f-423a-8292-ff6b26add01a req-4063268f-1e51-4838-b24b-dc31f06f5f84 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=c337eddc-a70e-4a8c-8701-85a39104333d&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0572782 May 25 15:45:27.896730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:27.910292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Deleting port 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:27.910893 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.036732 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Allocated IP 172.27.0.106 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/cd1cbcaf-cb70-4822-be0f-d1207ecf75f5) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:45:28.065515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] For port 3f734a1c-be04-4203-b351-6b0b6785f9ae, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3f734a1c-be04-4203-b351-6b0b6785f9ae,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:28.065871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.117173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46970) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:28.204758 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.242998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.249759 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.316451 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.333915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:45:28.354954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'Port': ['ID=cd1cbcaf-cb70-4822-be0f-d1207ecf75f5,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:28.370533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.377871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.378515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.378862 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Floating IP 4754fbd6-8842-4b6c-b280-b86c8a348c2f disassociated. External IP: 172.27.0.235, port: 3f734a1c-be04-4203-b351-6b0b6785f9ae. May 25 15:45:28.379213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling delete_port for 3f734a1c-be04-4203-b351-6b0b6785f9ae owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:28.381467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:28.385817 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:45:28.389795 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Usage tracker for resource:security_group_rule and tenant:5bb58cbae34f4887ad5d76d31b46db40 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:28.393488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:45:28.430399 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:28.443605 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:28.566999 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:28.581073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:28.632970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'Port': ['ID=3f734a1c-be04-4203-b351-6b0b6785f9ae,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:28.637787 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:28.802259 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-8c9d4d4e-54fb-49b1-95a8-b4b1e7b957a6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:28.804571 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-8c9d4d4e-54fb-49b1-95a8-b4b1e7b957a6 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.70 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.2786396 May 25 15:45:28.872312 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35964a37-661b-4df5-8898-5098cc8a7225 req-447649ec-0873-4bb5-98d5-e77d0fa6899e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:28.873802 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-35964a37-661b-4df5-8898-5098cc8a7225 req-447649ec-0873-4bb5-98d5-e77d0fa6899e tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 945 time: 0.3129613 May 25 15:45:28.949004 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a3cc9e72-2f58-49fe-8d01-df6afe78d4c0 req-f0b299f8-7d54-4afc-a5e4-489b214d999b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.0586092 May 25 15:45:28.990947 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:29.016749 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.037000 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-35964a37-661b-4df5-8898-5098cc8a7225 req-458df927-8377-4461-b83d-72f960db29fc tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/security-groups?id=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443298 May 25 15:45:29.040156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.049150 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-12c84096-8019-4eb4-a3ed-5fd9d75a1c2d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:29.092942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4533e155-5062-4a58-802a-b30a5c705f37,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:29.103000 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:29.118250 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=5bb58cbae34f4887ad5d76d31b46db40&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0002849 May 25 15:45:29.122310 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46982) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:29.218896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.255282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.293611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.319549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Deleting port c536b9e5-ae17-4775-b209-71e6ec42122a {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:29.319908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.332036 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.336883 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2a469400-113f-410d-918a-b2620e328fb4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:29.390725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:29.393836 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4533e155-5062-4a58-802a-b30a5c705f37,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:29.398804 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:29.401698 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:29.420465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.423289 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:29.424069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:29.463398 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.466869 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/4533e155-5062-4a58-802a-b30a5c705f37 HTTP/1.1" status: 204 len: 168 time: 0.3413081 May 25 15:45:29.489906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] No DVR routers for this DVR port 3f734a1c-be04-4203-b351-6b0b6785f9ae on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:29.494549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.497432 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-deleted', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:29.538200 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4a6a3f8c-e57d-45cc-b71a-74bce86d470f req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "DELETE /v2.0/ports/3f734a1c-be04-4203-b351-6b0b6785f9ae HTTP/1.1" status: 204 len: 173 time: 1.7701721 May 25 15:45:29.568057 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] For port c536b9e5-ae17-4775-b209-71e6ec42122a, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=c536b9e5-ae17-4775-b209-71e6ec42122a,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:29.568845 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.826080 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.838457 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:29.843946 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2bde8158-2100-401c-a4fe-de45877cb0fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:29.858611 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:29.912924 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Calling delete_port for c536b9e5-ae17-4775-b209-71e6ec42122a owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:29.917335 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 46994) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:29.968346 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9301f1db-ecb0-465b-858c-64a2bfd4d5cb', 'name': 'network-vif-deleted', 'tag': '3f734a1c-be04-4203-b351-6b0b6785f9ae', 'status': 'completed', 'code': 200} May 25 15:45:29.978424 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.011069 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event updated for resources: {'Port': ['ID=cd1cbcaf-cb70-4822-be0f-d1207ecf75f5,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:30.016545 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.017486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:30.024947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Usage tracker for resource:security_group_rule and tenant:8f1a62bc3cf343f891710639dea63d54 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:30.027646 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.079713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:30.099107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:30.134781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.142960 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-34b6937b-08f6-427d-93ff-f1f659c68b08 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.209932 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Pushing event deleted for resources: {'Port': ['ID=c536b9e5-ae17-4775-b209-71e6ec42122a,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:30.213874 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.254840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['c536b9e5-ae17-4775-b209-71e6ec42122a'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:45:30.295355 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6ee57528-56ba-468d-ad43-0f839cc375e7 req-38db66d6-054c-40a2-8a24-d21d95ea10bd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=9301f1db-ecb0-465b-858c-64a2bfd4d5cb HTTP/1.1" status: 200 len: 210 time: 0.1046131 May 25 15:45:30.315544 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f4d77ba8-70e6-4124-b3a7-09b07bf7fd90 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.326662 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Floating IP 386a1c8f-795c-4a8d-9633-1b03e066ac0d associated. External IP: 172.27.0.106, port: 7ae06ec7-6469-494a-b223-ce3de0a0e2da. May 25 15:45:30.354050 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] No DVR routers for this DVR port c536b9e5-ae17-4775-b209-71e6ec42122a on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:30.368307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.375176 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9d0b6e92-63e9-490c-bcbf-aa8c78afdc6c req-79e676c5-3500-4758-b7e0-9005ee8b1cde tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.36 "GET /v2.0/ports?device_id=17e39efa-e568-41dd-9368-376ead8b1020 HTTP/1.1" status: 200 len: 210 time: 0.0816493 May 25 15:45:30.396222 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a27b39cc-7211-4374-ba41-dfab9141b3cd req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] 10.222.0.70 "DELETE /v2.0/ports/c536b9e5-ae17-4775-b209-71e6ec42122a HTTP/1.1" status: 204 len: 173 time: 1.5661795 May 25 15:45:30.500396 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:30.505561 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:30.521316 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:30.522097 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:30.631337 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.639356 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.649198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-07df2588-3f67-4f54-8d0c-2fd404f1055c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:30.703823 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=8f1a62bc3cf343f891710639dea63d54&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7831423 May 25 15:45:30.704074 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47002) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:30.707419 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7343bbed-1b68-49ba-962c-66e83438ac84,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:30.731719 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:30.760081 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:30.909768 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:30.920950 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:30.955826 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Router 333e9bb6-af7f-4e54-8e33-f669ec06856d has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:30.969671 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 3f734a1c-be04-4203-b351-6b0b6785f9ae {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:30.969890 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3f734a1c-be04-4203-b351-6b0b6785f9ae not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:30.970341 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device c536b9e5-ae17-4775-b209-71e6ec42122a no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:30.976485 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.061368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: c536b9e5-ae17-4775-b209-71e6ec42122a {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:31.061586 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device c536b9e5-ae17-4775-b209-71e6ec42122a not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:31.203825 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.213243 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c2304aba-349f-4561-8a8a-69894aca99de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.228252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:31.233180 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56656cc3-8499-484b-969e-a88f1ded48ba None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:31.233486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7343bbed-1b68-49ba-962c-66e83438ac84,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:31.247706 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.251672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:31.253923 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.255422 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/7343bbed-1b68-49ba-962c-66e83438ac84 HTTP/1.1" status: 204 len: 168 time: 0.5504639 May 25 15:45:31.271162 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Sync routers for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:31.282719 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.286021 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:31.286747 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:31.360041 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 3.6374803 May 25 15:45:31.360041 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:31.441261 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'status': 'completed', 'code': 200} May 25 15:45:31.558126 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47018) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:31.582115 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:31.644361 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-e9de8b3f-8545-4326-8bdb-fe883271ed26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:31.646215 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-e9de8b3f-8545-4326-8bdb-fe883271ed26 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.1780498 May 25 15:45:31.700821 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.729553 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3880d72d-cf17-48fd-b879-472936e60d0f None None] New status for floating IP 4754fbd6-8842-4b6c-b280-b86c8a348c2f: DOWN {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:45:31.747633 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.833947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.849153 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c32a2d91-6e48-4c5f-94fe-82aa2e86905e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:31.870769 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47032) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:31.885602 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c337eddc-a70e-4a8c-8701-85a39104333d,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:31.897125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:31.900089 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.902396 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /v2.0/security-groups/c337eddc-a70e-4a8c-8701-85a39104333d HTTP/1.1" status: 204 len: 168 time: 0.3413022 May 25 15:45:31.903147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47036) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:31.907193 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:31.956445 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.api.v2.resource [None req-d0157d83-b13f-45e2-87ea-5e440cb176aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] show failed (client error): The resource could not be found. May 25 15:45:31.960146 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d0157d83-b13f-45e2-87ea-5e440cb176aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups/c337eddc-a70e-4a8c-8701-85a39104333d HTTP/1.1" status: 404 len: 347 time: 0.0531023 May 25 15:45:31.961532 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47046) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:31.971767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:31.977135 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'name': 'network-vif-deleted', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:31.985027 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-690a50ad-ad70-488b-8347-44dc742fd950 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:31.987836 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-690a50ad-ad70-488b-8347-44dc742fd950 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.3336966 May 25 15:45:31.989098 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Usage tracker for resource:security_group_rule and tenant:19486accf9174835b812d8dfaab21bc9 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:31.994203 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:32.144228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-b35b77f2-904e-477f-b001-96b5ebf641a9 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1000 time: 0.1459041 May 25 15:45:32.145909 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '17e39efa-e568-41dd-9368-376ead8b1020', 'name': 'network-vif-deleted', 'tag': 'c536b9e5-ae17-4775-b209-71e6ec42122a', 'status': 'completed', 'code': 200} May 25 15:45:32.155448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:32.292347 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-7df7b81b-0caf-401e-b1d8-01acb80ae7ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:32.293797 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-7df7b81b-0caf-401e-b1d8-01acb80ae7ac service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.1316202 May 25 15:45:32.323935 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '386a1c8f-795c-4a8d-9633-1b03e066ac0d', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'floating_ip_address': '172.27.0.106', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 522, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'mac_address': 'fa:16:3e:ff:d2:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:29Z', 'updated_at': '2021-05-25T15:45:29Z', 'revision_number': 0, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:32.328042 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Checking router: 333e9bb6-af7f-4e54-8e33-f669ec06856d for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:32.337557 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:32.338236 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:32.421528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Deleting port 58f86c62-d993-4050-ac05-c997927db6dc {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:32.422070 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.431628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.434115 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-77cee83c-bd9b-427a-9f54-b76e2dfb54ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:32.435619 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-77cee83c-bd9b-427a-9f54-b76e2dfb54ac service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1340456 May 25 15:45:32.440768 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.455114 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-af86afeb-5190-42f7-a5dc-14c63f241da4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:32.554836 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:32.565205 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.565630 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.583825 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=19486accf9174835b812d8dfaab21bc9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7120113 May 25 15:45:32.592750 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47072) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:32.645067 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.676087 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.679149 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=621758b8-dc50-46b7-9ca9-ad45de61044d,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:32.680329 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-80674728-8806-41c4-8251-9cb4e6d37c3b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.684475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:32.732818 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.737470 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling delete_port for 58f86c62-d993-4050-ac05-c997927db6dc owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:32.773162 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-b1a07ddc-47ca-4615-a2b7-c9dab26b6117 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3190417 May 25 15:45:32.869399 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47086) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:32.956346 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:32.963581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-53516e95-228b-4869-9103-cf8fbce7d64b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:33.015161 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '386a1c8f-795c-4a8d-9633-1b03e066ac0d', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'floating_ip_address': '172.27.0.106', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 522, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'mac_address': 'fa:16:3e:ff:d2:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:29Z', 'updated_at': '2021-05-25T15:45:29Z', 'revision_number': 0, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:33.016068 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.020613 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb5508a0-0b4d-478a-bd33-8fea8d082396 None None] The sync data for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi is: [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '386a1c8f-795c-4a8d-9633-1b03e066ac0d', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'floating_ip_address': '172.27.0.106', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 522, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'mac_address': 'fa:16:3e:ff:d2:a9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:29Z', 'updated_at': '2021-05-25T15:45:29Z', 'revision_number': 0, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:33.028015 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aa76dd56-6658-4257-894e-229e3fea9ff8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:33.058850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=621758b8-dc50-46b7-9ca9-ad45de61044d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:33.063546 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:33.066403 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32eaa2c9-5957-4d4c-a438-fedaaad02931 req-d7028e13-f6a8-46b1-a420-957709bfb922 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2822981 May 25 15:45:33.069020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.074116 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/621758b8-dc50-46b7-9ca9-ad45de61044d HTTP/1.1" status: 204 len: 168 time: 0.4764419 May 25 15:45:33.139414 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'Port': ['ID=58f86c62-d993-4050-ac05-c997927db6dc,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:33.175216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:33.250971 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-12e8e336-042b-4298-87a4-8b348d5f68b1 None None] New status for floating IP 386a1c8f-795c-4a8d-9633-1b03e066ac0d: ACTIVE {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:45:33.370029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.413689 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.417933 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f9b03b2b-335a-4eeb-a9b6-7bcd0d799282 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /v2.0/floatingips/4754fbd6-8842-4b6c-b280-b86c8a348c2f HTTP/1.1" status: 204 len: 168 time: 1.4524348 May 25 15:45:33.460311 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.727312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47106) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:33.732825 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1831918636', 'description': 'tempest-description--1628293480'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:33.739453 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:33.743581 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:33.746585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:33.753832 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.754335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:33.765899 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.792282 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:33.796212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:33.799131 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:33.805268 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:33.887299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.891594 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.895702 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bd32a9f9-aa0b-45e9-ac3a-31d42814f9be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:33.937372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4277f837-3eba-4c09-8333-b372c64011aa,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:33.941161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:33.942479 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.2141261 May 25 15:45:33.943498 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f3bea001-e9c3-4e4d-9841-c881848c227f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:33.945428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47116) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:33.951334 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group_rule': {'security_group_id': '4277f837-3eba-4c09-8333-b372c64011aa', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:33.957446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:33.962581 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:33.965687 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:33.972035 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:33.991200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.056681 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.060811 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.070254 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-205cf602-4f7b-4794-8111-ba793805ecc0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:34.092250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c90e4fe4-e271-4125-b918-652c1c6ac56f,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:34.097435 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:34.102609 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.106873 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-db3af5cb-5e1e-4bf7-839c-d5dc6e4d9414 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1571534 May 25 15:45:34.106873 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47126) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:34.112578 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'security_group_rule': {'security_group_id': '4277f837-3eba-4c09-8333-b372c64011aa', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:34.118445 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:34.122622 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:security_group_rule and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:34.125814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:34.135557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:34.157280 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.207162 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Deleting port 85083215-6cfc-4d24-9e98-c780cae18089 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:34.207895 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.226799 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.232167 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.234481 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:34.255444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=316543e1-b631-490e-9e35-c163739ece73,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:34.259464 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:34.270312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.271633 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-3c4eb79d-fe3b-4493-a1a7-1ad175b72677 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1639383 May 25 15:45:34.274560 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47152) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:34.280139 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:34.286124 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:34.290152 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Usage tracker for resource:floatingip and tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:34.293202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:34.298925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:34.312399 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.342802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] For port 85083215-6cfc-4d24-9e98-c780cae18089, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=85083215-6cfc-4d24-9e98-c780cae18089,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:34.343155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.463052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.469811 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Calling delete_port for 85083215-6cfc-4d24-9e98-c780cae18089 owned by network:router_interface {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:34.615722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Allocated IP 172.27.0.234 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/45625dae-4077-4658-85ab-556282c8aea8) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:45:34.794765 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.833628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.838246 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:34.898925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:45:34.901814 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:45:34.905371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:45:34.907304 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:34.912740 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ebd85e7-fd56-4392-9180-b29d3e9e8776 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:34.945600 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=45625dae-4077-4658-85ab-556282c8aea8,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:34.953380 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:34.958135 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Pushing event deleted for resources: {'Port': ['ID=85083215-6cfc-4d24-9e98-c780cae18089,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:34.961378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:34.999910 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.065038 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.174567 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.272029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.320315 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.326032 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.333773 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-24b868d6-19e3-4540-aa9a-29cbbe4c36e8 tempest-DeleteServersTestJSON-464621968 tempest-DeleteServersTestJSON-464621968-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:35.452925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=45625dae-4077-4658-85ab-556282c8aea8,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:35.456984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:35.463590 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.485154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:35.494592 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2110882 May 25 15:45:35.644592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Router 39dd6c05-7a84-4acc-a23b-40de52e09655 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:35.710012 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-3648a329-fa04-4997-9ded-742dc8d7489a req-e4058dd4-26a5-4133-b194-b95d2f60a511 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:35.729084 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-3648a329-fa04-4997-9ded-742dc8d7489a req-e4058dd4-26a5-4133-b194-b95d2f60a511 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:35.730490 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-e4058dd4-26a5-4133-b194-b95d2f60a511 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-securitygroup--1831918636&fields=id&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 267 time: 0.0610812 May 25 15:45:35.831559 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:35.840526 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Sync routers for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:35.845048 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] 10.222.0.36 "PUT /v2.0/routers/39dd6c05-7a84-4acc-a23b-40de52e09655/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9742427 May 25 15:45:35.848276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47202) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:35.854054 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:35.856055 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:35.900610 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-1aaed97c-185f-4ae9-b132-1e711d3a3e3f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:35.908347 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-1aaed97c-185f-4ae9-b132-1e711d3a3e3f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 816 time: 0.1707301 May 25 15:45:35.925143 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-569642b7-6a95-4509-bdb7-29455e39db7f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/quotas/c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 375 time: 0.0159323 May 25 15:45:36.023135 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-3648a329-fa04-4997-9ded-742dc8d7489a req-5f7e73e6-abe7-45ad-baf7-7232325a5d5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:36.038979 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-3648a329-fa04-4997-9ded-742dc8d7489a req-5f7e73e6-abe7-45ad-baf7-7232325a5d5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:36.040589 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-5f7e73e6-abe7-45ad-baf7-7232325a5d5f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1098437 May 25 15:45:36.050221 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks [] for router, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:36.052998 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:36.359150 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233'}], 'enable_snat': True}, 'gw_port_id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:45:34Z', 'revision_number': 5, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port': {'id': 'e99ce846-c3ba-4eab-9642-875905d174be', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:65:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'device_owner': 'network:router_gateway', 'standard_attr_id': 219, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.233', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:47Z', 'updated_at': '2021-05-25T15:40:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:36.363990 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:36.365430 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Checking router: 39dd6c05-7a84-4acc-a23b-40de52e09655 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:36.376446 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Routers {'39dd6c05-7a84-4acc-a23b-40de52e09655'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:36.377541 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['39dd6c05-7a84-4acc-a23b-40de52e09655'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:36.408592 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-5acc38d4-99f0-4463-9e00-e08d36aaffc5 service neutron] 10.222.0.36 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3521757 May 25 15:45:36.446133 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Deleting port e99ce846-c3ba-4eab-9642-875905d174be {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:36.446474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:36.538852 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] Set router 39dd6c05-7a84-4acc-a23b-40de52e09655 gateway port host: None {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:36.543087 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-0a4b005a-7709-46d9-ba29-78df6aceada9 service neutron] 10.222.0.36 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1289504 May 25 15:45:36.575246 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] For port e99ce846-c3ba-4eab-9642-875905d174be, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e99ce846-c3ba-4eab-9642-875905d174be,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:36.575599 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:36.707234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Calling delete_port for e99ce846-c3ba-4eab-9642-875905d174be owned by network:router_gateway {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:36.723263 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:45:36Z', 'revision_number': 6, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:36.727238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4801cedc-d258-4d94-b915-2498b80b68c2 None None] The sync data for ids ['39dd6c05-7a84-4acc-a23b-40de52e09655'] in dv-cinder-791239-3-iscsi is: [{'id': '39dd6c05-7a84-4acc-a23b-40de52e09655', 'name': 'tempest-TestMinimumBasicScenario-1925733587-router', 'tenant_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:40:46Z', 'updated_at': '2021-05-25T15:45:36Z', 'revision_number': 6, 'project_id': '55dc60a2768e4d2db35d44c21ff0e0a6', 'gw_port_host': None}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:36.751962 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 req-fe2e1f90-bed9-4f06-be01-f947ee137284 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:36.775560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 req-fe2e1f90-bed9-4f06-be01-f947ee137284 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:36.776743 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7c7ee44d-53fe-4cb5-bd36-3dcd7eeac510 req-fe2e1f90-bed9-4f06-be01-f947ee137284 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 210 time: 0.0776653 May 25 15:45:36.903569 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:36.908783 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-977382f2-41db-42f1-bef7-ad578035b929 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:36.952897 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Pushing event deleted for resources: {'Port': ['ID=e99ce846-c3ba-4eab-9642-875905d174be,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:36.956753 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:37.054175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.238267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.240830 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.323977 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.324578 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 39dd6c05-7a84-4acc-a23b-40de52e09655 {{(pid=98463) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:45:37.338688 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.339805 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] 10.222.0.36 "DELETE /v2.0/routers/39dd6c05-7a84-4acc-a23b-40de52e09655 HTTP/1.1" status: 204 len: 168 time: 1.4906271 May 25 15:45:37.342383 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47220) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:37.409389 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Deleting subnet 79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:45:37.412307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.461990 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.551547 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 85083215-6cfc-4d24-9e98-c780cae18089 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:37.589155 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 85083215-6cfc-4d24-9e98-c780cae18089 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:37.589505 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 85083215-6cfc-4d24-9e98-c780cae18089 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:37.589934 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e99ce846-c3ba-4eab-9642-875905d174be no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:37.590848 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.623621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: e99ce846-c3ba-4eab-9642-875905d174be {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:37.623990 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e99ce846-c3ba-4eab-9642-875905d174be not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:37.978342 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:37.993234 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e0c47a84-73b1-4a05-bb08-5b1177da390d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:38.005779 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-27fdb7e5-5aff-44d5-bfc1-681f7bebd577 req-e524e9d9-d4fd-4dd2-b25f-3de73777e389 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 210 time: 0.0655377 May 25 15:45:38.041587 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:38.058042 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.059065 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.068503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e1e719c-d769-4c8c-b41c-0455442d3cb0 None None] Network 07e4e701-ccf8-451e-b3d9-a809a6936fed requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:45:38.068750 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bc32dda0-502a-4238-8f9d-37df9ad318d1 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/79d7ba47-c91b-40b8-b4f3-0cc1ffd696cc HTTP/1.1" status: 204 len: 168 time: 0.7251961 May 25 15:45:38.076257 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47228) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:38.091048 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-51934f3d-4c60-422c-8bf9-12460d231bcd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:38.092578 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-51934f3d-4c60-422c-8bf9-12460d231bcd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 816 time: 0.2452910 May 25 15:45:38.190247 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-57246518-d85d-4745-99e0-54d4d3418be4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 380 time: 0.0693424 May 25 15:45:38.198507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.203205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'port': {'device_id': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'admin_state_up': True, 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'security_groups': ['4277f837-3eba-4c09-8333-b372c64011aa']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:38.279709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Deleting port 1a98a506-bb9a-4cab-849a-a0e636779c50 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:38.280097 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.357335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:38.359011 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] DHCP port deletion for 07e4e701-ccf8-451e-b3d9-a809a6936fed request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:45:38.367489 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:38.390692 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] For port 1a98a506-bb9a-4cab-849a-a0e636779c50, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=1a98a506-bb9a-4cab-849a-a0e636779c50,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:38.391165 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.393440 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Made reservation on behalf of c00f6cd8c3154d2f835d5f59da9cc7e3 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:45:38.397808 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.436876 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Deleting port 1a98a506-bb9a-4cab-849a-a0e636779c50 {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:38.437252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.528053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Calling delete_port for 1a98a506-bb9a-4cab-849a-a0e636779c50 owned by network:dhcp {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:38.536623 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] For port 1a98a506-bb9a-4cab-849a-a0e636779c50, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=1a98a506-bb9a-4cab-849a-a0e636779c50,segment=NetworkSegment(e4241c72-10f5-428f-970e-cab7555df934),segment_id=e4241c72-10f5-428f-970e-cab7555df934)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:38.536973 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.570833 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Allocated IP 172.20.0.9 (76bea034-0890-4bf6-b793-280aaec1a32c/2ce66291-0ef8-4b15-9e67-ba32027661fc/8c3b5d16-b63c-438e-a031-8606d9e7796f) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:45:38.581743 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.587919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:38.631467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Pushing event deleted for resources: {'Port': ['ID=1a98a506-bb9a-4cab-849a-a0e636779c50,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:38.640401 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.644884 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] No DVR routers for this DVR port 1a98a506-bb9a-4cab-849a-a0e636779c50 on host dv-cinder-791239-3-iscsi {{(pid=98463) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:38.661339 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Calling delete_port for 1a98a506-bb9a-4cab-849a-a0e636779c50 owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:38.674908 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:45:38.765671 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.779285 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['07e4e701-ccf8-451e-b3d9-a809a6936fed']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:38.789015 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.793083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e4241c72-10f5-428f-970e-cab7555df934') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:38.793396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e4241c72-10f5-428f-970e-cab7555df934') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:38.795674 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.801920 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:38.805542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.805928 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Transition to ACTIVE for port object 8c3b5d16-b63c-438e-a031-8606d9e7796f will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:45:38.828009 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.834828 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Releasing vlan 398 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:45:38.835219 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.844200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:45:38.849330 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:45:38.851448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f0417c0c-16b2-4ef2-b5fd-d1312037e5a3 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:38.855565 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Pushing event deleted for resources: {'Port': ['ID=1a98a506-bb9a-4cab-849a-a0e636779c50,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:38.864309 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] No DVR routers for this DVR port 1a98a506-bb9a-4cab-849a-a0e636779c50 on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:38.866211 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.866654 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.867068 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.867572 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.868000 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.868396 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.868788 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.869179 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.869568 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.869954 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.870357 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.870741 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:45:38.878417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.926268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.930664 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-44165dc0-7758-4f85-8fd7-25cf84396021 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:38.934559 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Network 76bea034-0890-4bf6-b793-280aaec1a32c is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:45:38.935354 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:38.937896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:45:38.939639 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.940330 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:45:38.952592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Pushing event deleted for resources: {'Network': ['ID=07e4e701-ccf8-451e-b3d9-a809a6936fed,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:38.952592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:38.959776 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:38.975945 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] 10.222.0.36 "DELETE /v2.0/networks/07e4e701-ccf8-451e-b3d9-a809a6936fed HTTP/1.1" status: 204 len: 168 time: 0.8983779 May 25 15:45:38.978547 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47238) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:39.014619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:39.014619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.040973 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8415239 May 25 15:45:39.063985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Request body: {'port': {'device_id': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:39.187449 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-deb58a30-8035-4135-ac78-deff1eed61d8 None None] Provisioning for port 8c3b5d16-b63c-438e-a031-8606d9e7796f completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:45:39.195040 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.196016 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-deb58a30-8035-4135-ac78-deff1eed61d8 None None] Provisioning complete for port 8c3b5d16-b63c-438e-a031-8606d9e7796f triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:45:39.196808 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-deb58a30-8035-4135-ac78-deff1eed61d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.274978 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-deb58a30-8035-4135-ac78-deff1eed61d8 None None] Port 8c3b5d16-b63c-438e-a031-8606d9e7796f cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:45:39.364917 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 1a98a506-bb9a-4cab-849a-a0e636779c50 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:39.374222 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7fc3586-7488-4d1f-a504-d9d294a0597b req-526d2867-3187-43fa-a015-044615b518a5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:39.375956 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c7fc3586-7488-4d1f-a504-d9d294a0597b req-526d2867-3187-43fa-a015-044615b518a5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 931 time: 0.2051840 May 25 15:45:39.402636 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 1a98a506-bb9a-4cab-849a-a0e636779c50 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:39.402985 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 1a98a506-bb9a-4cab-849a-a0e636779c50 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:39.559721 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:45:39.568308 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.583974 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Transition to ACTIVE for port object 8c3b5d16-b63c-438e-a031-8606d9e7796f will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:45:39.587944 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.591716 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-90f16b44-333c-460f-8447-954bd8e7f301 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:39.606536 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c7fc3586-7488-4d1f-a504-d9d294a0597b req-20d8b0b7-2285-4c71-80f0-b424c253acdd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:39.661672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-c7fc3586-7488-4d1f-a504-d9d294a0597b req-20d8b0b7-2285-4c71-80f0-b424c253acdd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:39.664537 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c7fc3586-7488-4d1f-a504-d9d294a0597b req-20d8b0b7-2285-4c71-80f0-b424c253acdd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2337575 May 25 15:45:39.721576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:39.725461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:39.845333 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:39.925786 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Attempting to bind port 8c3b5d16-b63c-438e-a031-8606d9e7796f on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:45:39.926029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Attempting to bind port 8c3b5d16-b63c-438e-a031-8606d9e7796f by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:45:39.926354 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Attempting to bind port 8c3b5d16-b63c-438e-a031-8606d9e7796f on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:45:39.930800 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Port 8c3b5d16-b63c-438e-a031-8606d9e7796f on network 76bea034-0890-4bf6-b793-280aaec1a32c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:45:39.931116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Attempting to bind port 8c3b5d16-b63c-438e-a031-8606d9e7796f on network 76bea034-0890-4bf6-b793-280aaec1a32c {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:45:39.936233 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 45, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:45:39.936505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Checking segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:45:39.936874 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Bound using segment: {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:45:39.937290 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Bound port: 8c3b5d16-b63c-438e-a031-8606d9e7796f, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8a902213-8048-4a9b-bc50-c79c837b967d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 389, 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:45:39.937632 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.033418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:45:40.036670 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:45:40.041218 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.045188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0fe2a9f3-7b9b-46c4-8040-2e95d0dc69c4 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:40.106029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:40.106558 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.107959 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] 10.222.0.70 "PUT /v2.0/ports/8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 1093 time: 1.0493691 May 25 15:45:40.108458 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:40.130933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:40.134287 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:40.199511 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'status': 'completed', 'code': 200} May 25 15:45:40.240210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-990bb03e-da9d-4834-91b0-5c68d97558cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:40.241766 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-990bb03e-da9d-4834-91b0-5c68d97558cd service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1096 time: 0.0841424 May 25 15:45:40.299590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Deleting port c68c0459-ae1d-41e5-b070-8bf111cd22d5 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:40.300057 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.328492 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-7bd7522b-f930-4f31-b3c5-1487945ba358 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 217 time: 0.0761549 May 25 15:45:40.401554 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-9f077149-5ca1-46a0-9993-5cbf2306f4c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:40.403007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-9f077149-5ca1-46a0-9993-5cbf2306f4c0 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0656984 May 25 15:45:40.434777 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] For port c68c0459-ae1d-41e5-b070-8bf111cd22d5, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c68c0459-ae1d-41e5-b070-8bf111cd22d5,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:40.435300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.487909 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3648a329-fa04-4997-9ded-742dc8d7489a req-030b0a12-14d0-472a-9ac0-f1865b96c76b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:40.489387 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-030b0a12-14d0-472a-9ac0-f1865b96c76b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0754693 May 25 15:45:40.561093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Calling delete_port for c68c0459-ae1d-41e5-b070-8bf111cd22d5 owned by network:router_interface {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:40.634069 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-262ea218-faa9-42f6-ad2b-ae9efb068694 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293061 May 25 15:45:40.714089 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:40.718643 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:40.761465 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Pushing event deleted for resources: {'Port': ['ID=c68c0459-ae1d-41e5-b070-8bf111cd22d5,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:40.764878 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:40.787205 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3648a329-fa04-4997-9ded-742dc8d7489a req-c6b50044-7a91-42e0-89a5-bc3d8e352f8d service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1431234 May 25 15:45:40.923759 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-738f08b3-ed68-4ea1-a106-62c49c3ade68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:40.925584 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-738f08b3-ed68-4ea1-a106-62c49c3ade68 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1096 time: 0.0795064 May 25 15:45:41.010437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89920b39-8438-49e4-b459-e343271ad745 req-5b2ca2e7-cec4-4f83-b4f6-82e9c8417589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:41.011979 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-89920b39-8438-49e4-b459-e343271ad745 req-5b2ca2e7-cec4-4f83-b4f6-82e9c8417589 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.2166429 May 25 15:45:41.068018 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-ac94c611-da72-47e9-bfdc-d076171f0960 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:41.068018 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-ac94c611-da72-47e9-bfdc-d076171f0960 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1310518 May 25 15:45:41.139118 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-89920b39-8438-49e4-b459-e343271ad745 req-873c9cef-1aeb-4316-b44a-259d4e6ce73b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1195924 May 25 15:45:41.140963 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:41.154318 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-bd10a0ef-d93d-4de4-aa47-6484352dfd93 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 217 time: 0.0664923 May 25 15:45:41.224539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-18e5859c-fe61-4e6e-99eb-1234404d37c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:41.226026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-18e5859c-fe61-4e6e-99eb-1234404d37c4 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0642114 May 25 15:45:41.319161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-5181564f-3578-4e3d-9cb1-3c76ebbd9e8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:41.320703 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-5181564f-3578-4e3d-9cb1-3c76ebbd9e8e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0834780 May 25 15:45:41.483869 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-e3a8caf9-f09e-4d28-a111-031760ef1509 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1417644 May 25 15:45:41.617307 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af1af746-c672-40c8-899f-846aa48ffaa2 req-5bec693e-dd02-4317-a8e6-49a55feed0d2 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258047 May 25 15:45:41.627736 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Router be216d63-ab76-431b-a541-90a9c25e4e84 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:41.814058 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:41.822907 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Sync routers for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:41.824217 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] 10.222.0.36 "PUT /v2.0/routers/be216d63-ab76-431b-a541-90a9c25e4e84/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8446434 May 25 15:45:41.826896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47256) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:41.833061 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:41.833670 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:42.000591 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks [] for router, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.011832 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:42.179369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.255162 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Deleting port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:42.255497 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.302550 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242'}], 'enable_snat': True}, 'gw_port_id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:45:40Z', 'revision_number': 5, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port': {'id': '8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:1c:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'device_owner': 'network:router_gateway', 'standard_attr_id': 266, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:41:04Z', 'updated_at': '2021-05-25T15:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:42.306483 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Checking router: be216d63-ab76-431b-a541-90a9c25e4e84 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:42.315785 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Routers {'be216d63-ab76-431b-a541-90a9c25e4e84'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:42.316438 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['be216d63-ab76-431b-a541-90a9c25e4e84'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:42.401485 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] For port 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:42.402212 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.441112 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 req-a8f97b2b-6064-47d7-9925-902da3f553a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:42.441776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 req-a8f97b2b-6064-47d7-9925-902da3f553a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Synchronizing usage tracker for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:42.458998 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 req-a8f97b2b-6064-47d7-9925-902da3f553a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Unset dirty status for tenant:c00f6cd8c3154d2f835d5f59da9cc7e3 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:42.460453 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 req-a8f97b2b-6064-47d7-9925-902da3f553a7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.2018063 May 25 15:45:42.469685 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] Set router be216d63-ab76-431b-a541-90a9c25e4e84 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:42.520454 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-37f8cf32-3a59-48da-8dd0-b78c2c0f5358 req-b2933a94-28f6-4733-a7c8-ff72c7b9f745 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0539148 May 25 15:45:42.558007 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Calling delete_port for 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a owned by network:router_gateway {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:42.581636 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:45:42Z', 'revision_number': 6, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:42.585637 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e51dffa1-9094-4865-9eac-71856f4ccdcd None None] The sync data for ids ['be216d63-ab76-431b-a541-90a9c25e4e84'] in dv-cinder-791239-3-iscsi is: [{'id': 'be216d63-ab76-431b-a541-90a9c25e4e84', 'name': 'tempest-TestMinimumBasicScenario-1881276553-router', 'tenant_id': '0ac68a1aab024cc6bdafb482b8270253', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:41:02Z', 'updated_at': '2021-05-25T15:45:42Z', 'revision_number': 6, 'project_id': '0ac68a1aab024cc6bdafb482b8270253', 'gw_port_host': None}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:42.647801 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.716194 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:42.720067 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:42.764617 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Pushing event deleted for resources: {'Port': ['ID=8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:42.767910 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:42.938881 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:45:42.978197 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.081875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:43.094602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:45:43.152229 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.155403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.158121 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.170875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:45:43.184024 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.184563 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Fanout notify agent at l3_agent the message router_deleted on router be216d63-ab76-431b-a541-90a9c25e4e84 {{(pid=98463) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:45:43.191172 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:43.195009 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.197361 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.197530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:43.198590 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-3f5a54d0-7ae5-469c-9d31-838ee6ed2d63 admin admin] 10.222.0.36 "DELETE /v2.0/routers/be216d63-ab76-431b-a541-90a9c25e4e84 HTTP/1.1" status: 204 len: 168 time: 1.3707144 May 25 15:45:43.201254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47264) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:43.265394 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:43.268356 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:43.268758 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Deleting subnet f8b27a4c-a2b0-40aa-b698-aaf984ec16be {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:45:43.271805 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.323406 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.402815 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c68c0459-ae1d-41e5-b070-8bf111cd22d5 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:43.414047 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.441075 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: c68c0459-ae1d-41e5-b070-8bf111cd22d5 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:43.441688 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c68c0459-ae1d-41e5-b070-8bf111cd22d5 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:43.442342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:43.478354 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:43.478718 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8fe6dc7f-1f8c-4291-8ba6-137fb7a8170a not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:43.583617 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['8c3b5d16-b63c-438e-a031-8606d9e7796f'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:45:43.768345 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed72a791-745b-45a1-857b-319bbb6359a4 req-6b8b53e8-5338-4303-90e4-7e6e3404738c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:43.769921 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ed72a791-745b-45a1-857b-319bbb6359a4 req-6b8b53e8-5338-4303-90e4-7e6e3404738c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 944 time: 0.1250761 May 25 15:45:43.771489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.776556 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ac1c1c90-9ee0-4100-a1f5-0cd807555780 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:43.813686 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f8b27a4c-a2b0-40aa-b698-aaf984ec16be,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:43.828873 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:43.832000 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:43.840012 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4f6964d-f6a0-4045-be3a-a1ef97929fe8 None None] Network 0d36140b-a597-4dfb-a417-ad474e1f632f requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:45:43.848945 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/f8b27a4c-a2b0-40aa-b698-aaf984ec16be HTTP/1.1" status: 204 len: 168 time: 0.6466858 May 25 15:45:43.851316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47272) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:43.883537 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ed72a791-745b-45a1-857b-319bbb6359a4 req-83bac1aa-159a-4948-ae26-71e40a652ab1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0794890 May 25 15:45:43.968530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.047357 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Deleting port 8852aea3-f8fb-409c-9034-67272cb22c8c {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:44.047698 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.105221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] DHCP port deletion for 0d36140b-a597-4dfb-a417-ad474e1f632f request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:45:44.149102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] For port 8852aea3-f8fb-409c-9034-67272cb22c8c, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8852aea3-f8fb-409c-9034-67272cb22c8c,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:44.149457 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.169902 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Deleting port 8852aea3-f8fb-409c-9034-67272cb22c8c {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:44.170279 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.270402 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] For port 8852aea3-f8fb-409c-9034-67272cb22c8c, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=8852aea3-f8fb-409c-9034-67272cb22c8c,segment=NetworkSegment(cbe9aa6f-59e5-4d9c-a49a-dcb74262e698),segment_id=cbe9aa6f-59e5-4d9c-a49a-dcb74262e698)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:44.270790 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.277486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Calling delete_port for 8852aea3-f8fb-409c-9034-67272cb22c8c owned by network:dhcp {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:44.325579 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.329215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:44.372520 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Pushing event deleted for resources: {'Port': ['ID=8852aea3-f8fb-409c-9034-67272cb22c8c,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:44.375501 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:44.376311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] No DVR routers for this DVR port 8852aea3-f8fb-409c-9034-67272cb22c8c on host dv-cinder-791239-3-iscsi {{(pid=98463) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:44.402122 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Calling delete_port for 8852aea3-f8fb-409c-9034-67272cb22c8c owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:44.445220 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.449064 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-281d1604-c625-4825-9cb5-e888be8da721 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:44.497244 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Pushing event deleted for resources: {'Port': ['ID=8852aea3-f8fb-409c-9034-67272cb22c8c,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:44.503047 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] No DVR routers for this DVR port 8852aea3-f8fb-409c-9034-67272cb22c8c on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:44.508040 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:44.593646 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.606930 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0d36140b-a597-4dfb-a417-ad474e1f632f']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:44.620197 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:44.620493 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cbe9aa6f-59e5-4d9c-a49a-dcb74262e698') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:44.631663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.647827 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.653755 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Releasing vlan 369 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:45:44.654132 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:45:44.670779 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:45:44.746633 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.751915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:44.765601 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:44.775745 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Pushing event deleted for resources: {'Network': ['ID=0d36140b-a597-4dfb-a417-ad474e1f632f,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:44.778747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:44.783119 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] 10.222.0.36 "DELETE /v2.0/networks/0d36140b-a597-4dfb-a417-ad474e1f632f HTTP/1.1" status: 204 len: 168 time: 0.9280028 May 25 15:45:44.956501 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:45:44.963371 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47282) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:45.025289 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 8c3b5d16-b63c-438e-a031-8606d9e7796f completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:45:45.032035 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 8c3b5d16-b63c-438e-a031-8606d9e7796f triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:45:45.032035 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.032297 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-52f7cb58-a487-491a-b57d-00d51edbcc6c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=55dc60a2768e4d2db35d44c21ff0e0a6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0660427 May 25 15:45:45.033877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47286) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:45.081679 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b523f54-9ef1-4cee-8f61-bc107a706216 req-d6e5f56f-eaa7-4320-97f9-27e7778f6c0c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:45.083261 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5b523f54-9ef1-4cee-8f61-bc107a706216 req-d6e5f56f-eaa7-4320-97f9-27e7778f6c0c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 944 time: 0.0889227 May 25 15:45:45.112264 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.138064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5b523f54-9ef1-4cee-8f61-bc107a706216 req-f70ef851-8b38-49d8-9754-0b81d418fb7a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472798 May 25 15:45:45.146535 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.162794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.189600 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:45.200894 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:45.205790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.206597 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.210151 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:45.210381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-80e1a04a-ee76-4040-a20b-c55177ff2971 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:45.230623 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f277e78b-c576-4ffa-b9c2-0ae2856bc3cc,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:45.233701 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:45.243784 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:45.247430 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f277e78b-c576-4ffa-b9c2-0ae2856bc3cc HTTP/1.1" status: 204 len: 168 time: 0.2083883 May 25 15:45:45.297911 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:45.301333 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:45.374931 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8852aea3-f8fb-409c-9034-67272cb22c8c no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:45.417182 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 8852aea3-f8fb-409c-9034-67272cb22c8c {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:45.417663 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 8852aea3-f8fb-409c-9034-67272cb22c8c not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:45.462183 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'code': 200} May 25 15:45:45.640231 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47302) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:45.712624 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb0e3fc9-29f6-4769-9243-04ba9397f404 req-cbaea8cc-68b8-4df0-b5ee-d1df715458fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:45.714128 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bb0e3fc9-29f6-4769-9243-04ba9397f404 req-cbaea8cc-68b8-4df0-b5ee-d1df715458fa service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1098 time: 0.0707877 May 25 15:45:45.760814 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bb0e3fc9-29f6-4769-9243-04ba9397f404 req-1b39557d-dcdc-43c7-9a60-400d50d86c3a service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0352874 May 25 15:45:45.913653 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1ffb5a23-d91a-46b0-89d1-0951a3de63c0 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=0ac68a1aab024cc6bdafb482b8270253&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2721398 May 25 15:45:45.915969 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47310) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:45.977493 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:46.003771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:46.057011 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:46.061767 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0f37e927-11a9-41a3-8db2-959830b16bd5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:46.074452 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7e57058-6c07-453f-acb9-391d28ee58f0,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:46.077297 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:46.079259 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:46.080360 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/d7e57058-6c07-453f-acb9-391d28ee58f0 HTTP/1.1" status: 204 len: 168 time: 0.1635172 May 25 15:45:46.347877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 req-4ebd5e9f-08a4-4d10-8d98-8576536ec825 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:46.349511 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 req-4ebd5e9f-08a4-4d10-8d98-8576536ec825 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0931520 May 25 15:45:46.400837 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dbe582d5-db4e-4e11-9d3a-52b93cf65f00 req-ae084984-574d-4d08-b63e-a34bf3724aae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455806 May 25 15:45:47.593199 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc req-9a310c17-abcf-49da-87a9-3de68507ffa1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:47.594577 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc req-9a310c17-abcf-49da-87a9-3de68507ffa1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0801573 May 25 15:45:47.639508 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-becd1511-e6c1-4c40-8ca4-51e9fd27f6fc req-362205bd-e13a-410d-b3a2-2aefbeca4999 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387986 May 25 15:45:47.822779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7614391-98ec-40c4-b149-a206ef23cc36 req-28008c41-a5f8-4dc3-a033-dd499f908edc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:47.824374 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a7614391-98ec-40c4-b149-a206ef23cc36 req-28008c41-a5f8-4dc3-a033-dd499f908edc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0815547 May 25 15:45:47.832772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47324) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:47.837930 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Request body: {'floatingip': {'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:47.916218 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:48.506044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:48.509769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:48.786281 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Floating IP 1158e8c8-9148-4b96-9327-a3c1359a3fa8 associated. External IP: 172.27.0.234, port: 8c3b5d16-b63c-438e-a031-8606d9e7796f. May 25 15:45:49.155079 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:49.344528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:49.348797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:49.355575 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:49.366266 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:49.367015 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:49.401373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51dfa728-6a54-4b45-b403-94ac226d103e req-2cd30f72-5e83-4d1c-a742-6e771a216b34 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:49.403053 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-51dfa728-6a54-4b45-b403-94ac226d103e req-2cd30f72-5e83-4d1c-a742-6e771a216b34 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0986819 May 25 15:45:49.411279 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-99543973-cd77-42b1-bd86-69b3697c1fbf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "PUT /v2.0/floatingips/1158e8c8-9148-4b96-9327-a3c1359a3fa8 HTTP/1.1" status: 200 len: 991 time: 1.5773458 May 25 15:45:49.412372 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:49.452523 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-51dfa728-6a54-4b45-b403-94ac226d103e req-a106474b-baca-436b-bf64-94e8cdd1801e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437376 May 25 15:45:49.512313 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'status': 'completed', 'code': 200} May 25 15:45:49.553977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:49.646549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-0f5f12ad-c5eb-46a4-9b2d-029227ae31de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:49.648065 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-0f5f12ad-c5eb-46a4-9b2d-029227ae31de service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1098 time: 0.0717063 May 25 15:45:49.787585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-da3ae31d-e045-4e75-a8d5-954829837b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:49.789131 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-da3ae31d-e045-4e75-a8d5-954829837b4a service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1307263 May 25 15:45:49.897133 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-30547d19-a69e-410c-9267-9d06cf682764 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 999 time: 0.0967858 May 25 15:45:49.938624 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1158e8c8-9148-4b96-9327-a3c1359a3fa8', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.234', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:34Z', 'updated_at': '2021-05-25T15:45:48Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:49.942455 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:49.950858 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:49.951470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:49.972452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-145cde72-9f20-4cae-83ff-3b5b1585a2f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:49.973897 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-145cde72-9f20-4cae-83ff-3b5b1585a2f8 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0586631 May 25 15:45:50.068929 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-cf3f99f2-2e99-4125-a411-efb861588cf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:50.070485 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-cf3f99f2-2e99-4125-a411-efb861588cf0 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0733631 May 25 15:45:50.140442 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:50.211961 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-c12007e6-4a04-4e14-93cf-4c68ccc1e694 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282692 May 25 15:45:50.354078 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3f0ea1fb-bb5c-4dc5-8a0f-85bc01f0c458 req-7df7ede4-8cfa-4232-ae7d-983dfc66fb42 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1264846 May 25 15:45:50.496683 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1158e8c8-9148-4b96-9327-a3c1359a3fa8', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.234', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:34Z', 'updated_at': '2021-05-25T15:45:48Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:50.500910 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a0953ff-a2ad-4bc7-88b3-d37615c4366d None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '1158e8c8-9148-4b96-9327-a3c1359a3fa8', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'floating_ip_address': '172.27.0.234', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:34Z', 'updated_at': '2021-05-25T15:45:48Z', 'revision_number': 1, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:50.650834 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27c8cb68-7062-42af-b57d-02c4a632e04e req-583830cf-823c-4248-add7-fb725630023f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:50.652465 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-27c8cb68-7062-42af-b57d-02c4a632e04e req-583830cf-823c-4248-add7-fb725630023f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0856535 May 25 15:45:50.695356 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575bb814-5e6e-4b70-ae06-d6508de67cec None None] New status for floating IP 1158e8c8-9148-4b96-9327-a3c1359a3fa8: ACTIVE {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:45:50.703256 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-27c8cb68-7062-42af-b57d-02c4a632e04e req-639179e2-968f-404b-87fd-988172b35d38 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443408 May 25 15:45:51.591942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-076c11ae-67a4-4bca-b363-2f945c2782a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:51.593306 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-076c11ae-67a4-4bca-b363-2f945c2782a0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.0817659 May 25 15:45:51.739284 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Deleting port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:51.739837 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.013080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] For port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:45:52.013420 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.112892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20163dbe-3fe2-4cc8-91d8-789ffd90612b req-17edae47-fe4a-489b-bbc5-34e917a567a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:52.114346 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-20163dbe-3fe2-4cc8-91d8-789ffd90612b req-17edae47-fe4a-489b-bbc5-34e917a567a6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 945 time: 0.2903759 May 25 15:45:52.240495 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-20163dbe-3fe2-4cc8-91d8-789ffd90612b req-16916a27-bc3e-439c-85a9-b12e142fee6c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=cd97f1d8-9ac1-485f-9c3d-f94469df3e03&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1190445 May 25 15:45:52.351328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.351697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.352047 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Floating IP 6016d7d3-3093-4cb9-aacb-3a642caf656e disassociated. External IP: 172.27.0.200, port: cfbb7459-c8f7-4441-8886-be2a6b4ad1a7. May 25 15:45:52.352392 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling delete_port for cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:52.466986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.473419 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bec62a75-304a-4a9f-90d4-3f6afc72d1e6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:52.521643 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'Port': ['ID=cfbb7459-c8f7-4441-8886-be2a6b4ad1a7,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:52.524659 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:52.703407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:45:52.891139 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:45:52.901653 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:45:52.912175 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:52.912936 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:52.971073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] No DVR routers for this DVR port cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:45:52.976184 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:52.978946 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'name': 'network-vif-deleted', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:45:52.998693 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c163fa5a-9f79-4914-a7cf-aa2225e55e98 req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "DELETE /v2.0/ports/cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 HTTP/1.1" status: 204 len: 173 time: 1.3930457 May 25 15:45:53.030252 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '92aed9d5-56b6-4cbf-9678-b16f7de68b23', 'name': 'network-vif-deleted', 'tag': 'cfbb7459-c8f7-4441-8886-be2a6b4ad1a7', 'status': 'completed', 'code': 200} May 25 15:45:53.106918 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:53.402150 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b req-238fb086-52e9-4379-afcb-0ea73f43a270 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:53.416180 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:53.418568 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b req-238fb086-52e9-4379-afcb-0ea73f43a270 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:53.419795 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-549228f8-b1af-43f0-b6b1-c7e37fe8b26b req-238fb086-52e9-4379-afcb-0ea73f43a270 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=92aed9d5-56b6-4cbf-9678-b16f7de68b23 HTTP/1.1" status: 200 len: 210 time: 0.0612781 May 25 15:45:53.421049 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:45:53.429982 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:45:53.430594 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:45:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:53.670268 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:45:53.981342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:45:53.985138 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ffe4d47-f2c0-4ad5-8536-5e405953dd87 None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:45:54.182751 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40adbae3-a075-4ccb-893a-6099264bf1d0 None None] New status for floating IP 6016d7d3-3093-4cb9-aacb-3a642caf656e: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:45:54.543715 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47388) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:54.607276 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:54.635230 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:54.688396 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:54.693636 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-55b6195e-7dfc-4889-b784-50d1ce0590d6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:54.710837 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd97f1d8-9ac1-485f-9c3d-f94469df3e03,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:54.715341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:54.719158 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:54.720307 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-6bbc97a1-8742-42e3-bc38-26d7008122a4 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /v2.0/security-groups/cd97f1d8-9ac1-485f-9c3d-f94469df3e03 HTTP/1.1" status: 204 len: 168 time: 0.1755445 May 25 15:45:54.722948 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47394) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:54.740204 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.api.v2.resource [None req-c113144f-2f75-4de7-9e33-3f17ccf4a5af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] show failed (client error): The resource could not be found. May 25 15:45:54.741169 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c113144f-2f75-4de7-9e33-3f17ccf4a5af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups/cd97f1d8-9ac1-485f-9c3d-f94469df3e03 HTTP/1.1" status: 404 len: 347 time: 0.0171440 May 25 15:45:54.743836 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47398) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:54.954180 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Deleting port 9882a674-5864-4482-9c88-be96a363ceff {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:45:54.954458 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.033943 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:45:55.073445 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:45:55.073810 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device cfbb7459-c8f7-4441-8886-be2a6b4ad1a7 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:45:55.169358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.169680 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.296860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling delete_port for 9882a674-5864-4482-9c88-be96a363ceff owned by network:floatingip {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:45:55.409321 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.412739 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b5a0cc5b-71c0-4b6a-96fb-14b8af96af61 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:55.459692 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'Port': ['ID=9882a674-5864-4482-9c88-be96a363ceff,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:55.491767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:55.552065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.570463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:55.571574 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /v2.0/floatingips/6016d7d3-3093-4cb9-aacb-3a642caf656e HTTP/1.1" status: 204 len: 168 time: 0.8268721 May 25 15:45:56.289844 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47412) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:56.295336 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1222461500', 'description': 'tempest-description--386665166'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:56.301658 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:56.306384 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:56.309564 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:56.317228 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:56.326859 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.346299 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:56.350002 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:56.352740 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:56.358270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:56.430459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.434125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.438088 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d465ea45-fdb6-4002-9030-2793bd26312c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:56.482374 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4b54599f-0e93-4f9f-bb1a-60b25e29ab38,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:56.485093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.490204 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47418) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:56.490295 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.1987917 May 25 15:45:56.490738 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:56.494990 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group_rule': {'security_group_id': '4b54599f-0e93-4f9f-bb1a-60b25e29ab38', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:56.501152 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:56.505481 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:56.508325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:56.514228 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:56.530213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.592139 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.596307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.603538 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:56.623792 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e138524e-2e37-4d81-b8ff-f343aaae758f,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:56.626118 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:56.630647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.631847 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-3d081a92-b539-4fe1-be6b-972d650a06be tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1411805 May 25 15:45:56.634504 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47422) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:56.640082 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'security_group_rule': {'security_group_id': '4b54599f-0e93-4f9f-bb1a-60b25e29ab38', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:56.645717 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:56.649541 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:security_group_rule and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:56.652392 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:56.658522 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:56.675321 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.734620 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.738332 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555113'] for security_group_rule, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.740412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:56.761336 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb9f8fed-282d-4659-b19b-321f0b2b591a,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:56.764204 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:56.771007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group_rule, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.772200 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-2703c0a0-ab47-491d-8823-47f6fc95e98e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1366973 May 25 15:45:56.775175 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47426) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:45:56.780365 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:45:56.786221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:45:56.789911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Usage tracker for resource:floatingip and tenant:42ea914db4fc4438a1d50bfff262a6e8 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:45:56.792674 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:45:56.799106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:45:56.809164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:56.945534 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.083634 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Allocated IP 172.27.0.42 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/c20ee1c1-fc18-42ce-9810-28158e3de9d6) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:45:57.232162 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.261539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.266328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dfe4b93-b040-4aa5-8dde-1e8c835281bf tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:57.328297 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:45:57.331513 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:45:57.335504 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:45:57.369418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=c20ee1c1-fc18-42ce-9810-28158e3de9d6,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:57.375411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:57.423717 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.489831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.707451 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.711946 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.716443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:45:57.821530 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=c20ee1c1-fc18-42ce-9810-28158e3de9d6,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:45:57.825906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:45:57.835178 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.857692 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:45:57.858908 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.0827889 May 25 15:45:58.100215 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-92ad4846-8f65-43dc-81b9-e290d3ecb8f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:58.116328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-92ad4846-8f65-43dc-81b9-e290d3ecb8f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:58.117441 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-92ad4846-8f65-43dc-81b9-e290d3ecb8f0 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-securitygroup--1222461500&fields=id&tenant_id=42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 267 time: 0.1377134 May 25 15:45:58.265534 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-47631b7e-baee-45f9-b41d-b8d7c7d2bc48 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:45:58.267006 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-47631b7e-baee-45f9-b41d-b8d7c7d2bc48 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 811 time: 0.1424072 May 25 15:45:58.280970 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-a8cb845a-2328-4aa2-ac9b-ff6bdbdc70ac tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/quotas/42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 375 time: 0.0086076 May 25 15:45:58.362810 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-5a725c0e-3a3a-4134-b166-0cb5fb573468 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:45:58.380083 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-5a725c0e-3a3a-4134-b166-0cb5fb573468 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:45:58.384870 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-5a725c0e-3a3a-4134-b166-0cb5fb573468 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0986898 May 25 15:45:58.523311 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-109f7927-d285-4312-83cd-a7936cfd709d service neutron] 10.222.0.36 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243904 May 25 15:45:58.660491 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-810443c7-133f-45a3-aff5-5653ae1e2bd5 service neutron] 10.222.0.36 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1314414 May 25 15:45:58.867570 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f4db790f-e307-4fbb-b3da-0f8d8d95e936 req-4017dcc9-d7e3-4f4c-ac75-804c0350c441 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0494065 May 25 15:45:59.975253 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-ece24609-b089-4ba4-8593-4851367df9b3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:00.045270 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4cfdd75a-edd9-4293-9388-160979b84520 req-48f40014-abc0-4ebf-a423-7da08ee752c2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0552349 May 25 15:46:01.196066 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-046b2aa1-76ed-4fa6-b611-2ecbbd2b1a1f req-a8e81a27-2843-458b-aed1-8b502b37ff06 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0461452 May 25 15:46:02.491533 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6a0ca5b2-17e8-4dbe-9efb-274a77102a3e req-5a593873-31ea-460d-9890-55b4a907ae81 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0430582 May 25 15:46:02.627502 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:02.681920 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a968ec8-3c80-4ded-bdfc-c9007451beb0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.062501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-41653b44-1144-43b0-aecd-57e41e1e8e6e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:03.063947 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-41653b44-1144-43b0-aecd-57e41e1e8e6e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 811 time: 0.1450155 May 25 15:46:03.116505 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-f4689861-94b0-405e-b355-7e59492b89d9 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=42ea914db4fc4438a1d50bfff262a6e8 HTTP/1.1" status: 200 len: 380 time: 0.0404763 May 25 15:46:03.129267 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'port': {'device_id': '4b093877-20ab-4678-8d94-a89983bda325', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'admin_state_up': True, 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'security_groups': ['4b54599f-0e93-4f9f-bb1a-60b25e29ab38']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:03.268343 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:03.279514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:03.289632 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Made reservation on behalf of 42ea914db4fc4438a1d50bfff262a6e8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:46:03.293177 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.450427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.465789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Allocated IP 172.20.0.7 (320ad3f5-0f83-444c-8df0-70303c7a4446/02ba8877-ef07-4ef0-b677-beca89c84dcb/a7d32eab-b1e5-4dcd-bb06-5f06e6841586) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:46:03.647056 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aede9fa0-c342-4695-bb00-2a5b793817a9 req-f25e71a4-dd5a-4200-9291-8b354169086d tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0450373 May 25 15:46:03.659153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.675404 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Transition to ACTIVE for port object a7d32eab-b1e5-4dcd-bb06-5f06e6841586 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:46:03.699386 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.705174 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dd3d60c3-5e4c-4d56-b6a9-9eb5ff258fcd service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:03.774137 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:46:03.776938 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:46:03.780869 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:46:03.813099 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event updated for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:03.833017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.833390 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.833745 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.834095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.834445 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.834796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.835139 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.835483 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.835822 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.836186 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.836526 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.836863 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:03.842874 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:03.862330 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:03.862953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:03.888921 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7643661 May 25 15:46:03.904074 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Request body: {'port': {'device_id': '4b093877-20ab-4678-8d94-a89983bda325', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:03.992005 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-5b60240f-3d68-40bf-9a31-b9bfbdecf35b None None] Provisioning for port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:46:03.997198 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-5b60240f-3d68-40bf-9a31-b9bfbdecf35b None None] Provisioning complete for port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:46:03.997584 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-5b60240f-3d68-40bf-9a31-b9bfbdecf35b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.017363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.052266 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-5b60240f-3d68-40bf-9a31-b9bfbdecf35b None None] Port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:46:04.434099 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a7d32eab-b1e5-4dcd-bb06-5f06e6841586 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:46:04.441213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.455934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Transition to ACTIVE for port object a7d32eab-b1e5-4dcd-bb06-5f06e6841586 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:46:04.459478 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.463930 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9dd6d368-ea37-4908-a90a-4926c8dc38cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.629413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Pushing event updated for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:04.633468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:04.716995 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Attempting to bind port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:46:04.717334 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Attempting to bind port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:46:04.717663 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Attempting to bind port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:46:04.725929 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:46:04.726313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Attempting to bind port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 on network 320ad3f5-0f83-444c-8df0-70303c7a4446 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:46:04.731933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 45, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:46:04.732491 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Checking segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:46:04.733327 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Bound using segment: {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:46:04.733789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Bound port: a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 364, 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:46:04.734137 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.833983 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:46:04.837200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:46:04.842650 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.845232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b78039-f145-47a7-8bd1-0671867c37a9 req-ff94fcf1-502e-4833-9df5-c30593eb32ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:04.847021 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-97b78039-f145-47a7-8bd1-0671867c37a9 req-ff94fcf1-502e-4833-9df5-c30593eb32ca tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 943 time: 0.0856552 May 25 15:46:04.847306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-112d7a45-89c6-435d-97ac-cf73f38429fc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:04.889925 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-97b78039-f145-47a7-8bd1-0671867c37a9 req-4d895b2f-4fcc-4f54-88ec-cd74db591f2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:46:04.901842 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-97b78039-f145-47a7-8bd1-0671867c37a9 req-4d895b2f-4fcc-4f54-88ec-cd74db591f2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:46:04.902868 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-97b78039-f145-47a7-8bd1-0671867c37a9 req-4d895b2f-4fcc-4f54-88ec-cd74db591f2b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504544 May 25 15:46:04.904491 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:04.905103 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:04.906530 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] 10.222.0.70 "PUT /v2.0/ports/a7d32eab-b1e5-4dcd-bb06-5f06e6841586 HTTP/1.1" status: 200 len: 1093 time: 1.0068498 May 25 15:46:04.907022 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:04.927500 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Pushing event updated for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:04.931152 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:05.002781 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'status': 'completed', 'code': 200} May 25 15:46:05.046599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-f0d14a7d-a24a-42c3-b1c3-1d2172ebd044 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.048707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-f0d14a7d-a24a-42c3-b1c3-1d2172ebd044 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 1096 time: 0.0819521 May 25 15:46:05.121824 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-5ea4b70d-de09-4890-9ad6-aaf1a315fc66 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586 HTTP/1.1" status: 200 len: 217 time: 0.0622289 May 25 15:46:05.168698 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:05.192284 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-293aef36-a7a2-41a1-9c9b-3e6c4be3ffd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.193643 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-293aef36-a7a2-41a1-9c9b-3e6c4be3ffd1 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0651355 May 25 15:46:05.270325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-7fa7da2c-bbc0-4204-b88c-c362fafb6acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.271794 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-7fa7da2c-bbc0-4204-b88c-c362fafb6acf service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0709894 May 25 15:46:05.406223 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-e2c79294-9afd-4f2f-8665-ec1f0adf0959 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260815 May 25 15:46:05.539910 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b8f6ce78-17d5-4de7-bec3-ca221845832b req-aae6cf1d-ef16-48b8-96a2-c006a6878933 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255133 May 25 15:46:05.675479 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-43860861-51b6-4250-b3b8-7840ea05f5a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.676984 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-43860861-51b6-4250-b3b8-7840ea05f5a0 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 1096 time: 0.0795310 May 25 15:46:05.817826 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-cdbb1625-bd05-44f5-9432-1b5128fbd692 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.819348 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-cdbb1625-bd05-44f5-9432-1b5128fbd692 service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.1301935 May 25 15:46:05.890570 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-a12c49ca-1bf1-4778-a67a-e9201e2a064d service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586 HTTP/1.1" status: 200 len: 217 time: 0.0622921 May 25 15:46:05.967542 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-c0b0ae3b-05af-42ac-8b7e-da8d1ebd6b60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:05.969058 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-c0b0ae3b-05af-42ac-8b7e-da8d1ebd6b60 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0673301 May 25 15:46:06.194429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-af08692c-223c-4713-a980-94c6dfc328e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:06.195845 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-af08692c-223c-4713-a980-94c6dfc328e2 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2182999 May 25 15:46:06.209038 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47dfa9af-48ff-4dd5-994d-3861a1b0038d req-2d222e9a-0b11-4819-9b94-e9ab286f94e1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:06.209739 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47dfa9af-48ff-4dd5-994d-3861a1b0038d req-2d222e9a-0b11-4819-9b94-e9ab286f94e1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Synchronizing usage tracker for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:46:06.295665 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-47dfa9af-48ff-4dd5-994d-3861a1b0038d req-2d222e9a-0b11-4819-9b94-e9ab286f94e1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Unset dirty status for tenant:42ea914db4fc4438a1d50bfff262a6e8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:46:06.296841 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-47dfa9af-48ff-4dd5-994d-3861a1b0038d req-2d222e9a-0b11-4819-9b94-e9ab286f94e1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 943 time: 0.2782812 May 25 15:46:06.377127 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-47dfa9af-48ff-4dd5-994d-3861a1b0038d req-48c6196b-e9dd-42c2-9c18-e04ad4f906b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732043 May 25 15:46:06.385412 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-70965ef7-976a-44e9-b3ce-161483bded9b service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1703343 May 25 15:46:06.521538 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3ca2c7f4-7849-45f5-940f-4ec9d53239bc req-8ce2b8d8-0899-4573-8f5e-f3d9f7cfefc3 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1249025 May 25 15:46:07.111282 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device a7d32eab-b1e5-4dcd-bb06-5f06e6841586 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:46:07.250823 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:07.263984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'port_id': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'mac_address': 'fa:16:3e:a3:cb:86', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 364, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:46:07.317658 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:07.334488 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a7d32eab-b1e5-4dcd-bb06-5f06e6841586 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:46:07.349859 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:07.353340 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:07.355046 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-05459099-cc32-4045-90b8-f0a7f8fc4e50 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:07.424471 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:07.427498 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:07.568579 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef req-b24baa52-73d4-4546-b95b-318f654df2ba tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:07.570034 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef req-b24baa52-73d4-4546-b95b-318f654df2ba tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 944 time: 0.0819259 May 25 15:46:07.614290 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-08e9eb96-5477-443a-8cd8-ffaa07a6b1ef req-04c4b543-d6ec-493e-b8f9-b4be1b65f770 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374124 May 25 15:46:07.659267 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['a7d32eab-b1e5-4dcd-bb06-5f06e6841586'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:46:08.517491 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47544) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:46:08.645568 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:08.660474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:08.664237 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Usage tracker for resource:security_group_rule and tenant:df02c8a7efc246b18e150b564c02a6b3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:46:08.667025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:46:08.672619 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:08.756581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:08.760733 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:08.769486 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b9d70b65-9c7f-4fa6-a42d-f4e8e3cd85ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:08.808216 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=510e275f-1b48-4614-b729-282e1840467e,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:08.812301 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd req-44f62572-c5d0-4c85-9c2f-fffb70c6ffed tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:08.813836 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd req-44f62572-c5d0-4c85-9c2f-fffb70c6ffed tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 944 time: 0.0844245 May 25 15:46:08.817733 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=df02c8a7efc246b18e150b564c02a6b3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2991903 May 25 15:46:08.819291 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.819674 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.820124 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.820482 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.820852 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.821107 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47552) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:46:08.821295 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.821633 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.822001 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.822366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.822725 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.823088 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.823444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:46:08.828009 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:08.897772 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-441d16bc-7a2f-4934-b3d0-31b0ab48c7cd req-d00346c7-dd8c-436b-b217-cdd56363c455 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0780282 May 25 15:46:08.919340 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:08.945037 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.000232 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.004261 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e3c0de5a-e8c7-4221-b369-8589af6cf33f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.015386 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=510e275f-1b48-4614-b729-282e1840467e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:09.019326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.022904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.024042 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/510e275f-1b48-4614-b729-282e1840467e HTTP/1.1" status: 204 len: 168 time: 0.2019272 May 25 15:46:09.127701 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device a7d32eab-b1e5-4dcd-bb06-5f06e6841586 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:46:09.200488 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:46:09.206574 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:46:09.206987 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.325430 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.352451 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:09.363054 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:09.367033 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.371967 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:09.402641 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'code': 200} May 25 15:46:09.441046 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:09.450963 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:09.652024 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc3814f-dcf9-49fd-908f-feb632322ed3 req-470c87cc-0b57-4f47-a07b-d0335ad6b9a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:09.653521 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7cc3814f-dcf9-49fd-908f-feb632322ed3 req-470c87cc-0b57-4f47-a07b-d0335ad6b9a0 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 1098 time: 0.0725050 May 25 15:46:09.703146 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7cc3814f-dcf9-49fd-908f-feb632322ed3 req-e9133c2a-05ef-4bd9-ba3e-d4a4e8d23dd2 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359461 May 25 15:46:09.710274 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47580) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:46:09.815804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-442597107-network', 'tenant_id': 'fd3e84780cc8404caa2bc8b9b90bcfab'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:09.820599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:09.824425 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Usage tracker for resource:network and tenant:fd3e84780cc8404caa2bc8b9b90bcfab is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:46:09.827211 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:46:09.833350 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:09.843515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Made reservation on behalf of fd3e84780cc8404caa2bc8b9b90bcfab for: {'network': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:46:09.846293 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.857786 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.872066 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:09.875756 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Usage tracker for resource:security_group_rule and tenant:fd3e84780cc8404caa2bc8b9b90bcfab is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:46:09.878531 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:46:09.884226 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:09.972569 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.976493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:09.980504 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d786337-a2cc-48b4-87ad-5588caa2f79d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:10.004636 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 390} {{(pid=98462) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:46:10.018155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:10.022330 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.023271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.023613 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.segments_db [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Added segment 915eeaf5-0ce1-4cff-820c-f43904e568be of type vlan for network 3c515845-6e63-4d8b-b829-eb7af03f0236 May 25 15:46:10.052414 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.081647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.083047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:10.083639 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.088225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:10.097143 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 req-9c8c9f00-66dc-451c-86ec-940e7200c04c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:10.098623 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 req-9c8c9f00-66dc-451c-86ec-940e7200c04c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0879099 May 25 15:46:10.146083 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5c2f0706-bf21-4b02-a7c0-a172e079ecf1 req-e460cba1-6cd6-4e0e-960c-9aaee701227e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416102 May 25 15:46:10.186118 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.4747603 May 25 15:46:10.188996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 47590) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:46:10.196694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Request body: {'subnet': {'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-442597107-subnet', 'tenant_id': 'fd3e84780cc8404caa2bc8b9b90bcfab', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:10.199663 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Pushing event updated for resources: {'Network': ['ID=3c515845-6e63-4d8b-b829-eb7af03f0236,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:10.202804 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.203701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:10.208250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Usage tracker for resource:subnet and tenant:fd3e84780cc8404caa2bc8b9b90bcfab is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:46:10.211164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:46:10.215721 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:46:10.217531 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:10.228884 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Made reservation on behalf of fd3e84780cc8404caa2bc8b9b90bcfab for: {'subnet': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:46:10.231170 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10881158'] for subnet, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.609128 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1633497', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10881168'] for subnet, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.613528 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e1c0ac42-2884-4310-a177-1535f4f1c7f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:10.689212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cc10550a-268b-4838-b7df-f6dc84fd8286,revision_number=0']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:10.692222 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:10.701200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Checking segment: {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:46:10.701556 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Network hostable DHCP agents. Network: 3c515845-6e63-4d8b-b829-eb7af03f0236, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98462) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:46:10.720231 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98462) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:46:10.729585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 3c515845-6e63-4d8b-b829-eb7af03f0236) {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:46:10.738093 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:10.738724 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:10.739258 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3dd0542-8e10-4ce7-afc2-49257d04e1bc None None] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:46:10.767480 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.5732489 May 25 15:46:10.952977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e4421d79-29a6-4ce5-bd2e-f22683739fe5 None None] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:46:11.073664 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-7ebc0e7f-ea55-47ea-9e8e-f2a9fbed16e7 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0826840 May 25 15:46:11.178797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9efe63-4953-4806-a57d-05893747c45f req-ecd0b293-19aa-4de0-9764-835bc49dda48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.180289 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-ecd0b293-19aa-4de0-9764-835bc49dda48 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 1098 time: 0.0780594 May 25 15:46:11.356085 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c788b36b-9e99-4b83-8b84-70d15a791aee req-e2442b12-2fb4-4c40-bf0a-9be9ace36af8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.357620 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c788b36b-9e99-4b83-8b84-70d15a791aee req-e2442b12-2fb4-4c40-bf0a-9be9ace36af8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0854242 May 25 15:46:11.421572 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c788b36b-9e99-4b83-8b84-70d15a791aee req-cd6bd8a0-15f6-4b53-8e93-942f61790029 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564055 May 25 15:46:11.478523 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9efe63-4953-4806-a57d-05893747c45f req-3ea0c0ed-df85-4239-bba3-06a41b76f2a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.480199 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-3ea0c0ed-df85-4239-bba3-06a41b76f2a3 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.2707021 May 25 15:46:11.655312 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-5f6e2daa-bc9b-414c-951b-43443925126a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 200 len: 1001 time: 0.1638255 May 25 15:46:11.729855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 req-e2cf751c-a4c7-445d-9b9b-348665e61735 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.731214 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8d9ce15b-3383-497c-8e74-cbbaf3cac1a3 req-e2cf751c-a4c7-445d-9b9b-348665e61735 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.1749957 May 25 15:46:11.738779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9efe63-4953-4806-a57d-05893747c45f req-80310c3f-37fb-4cdb-8598-fe27245a881a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.740055 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 47614) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:46:11.740254 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-80310c3f-37fb-4cdb-8598-fe27245a881a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0768340 May 25 15:46:11.745444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Request body: {'floatingip': {'port_id': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:11.821617 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:11.840612 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9efe63-4953-4806-a57d-05893747c45f req-94bb0fff-c1f4-4e37-a88d-f22aeb6a41b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:11.842582 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-94bb0fff-c1f4-4e37-a88d-f22aeb6a41b4 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0845926 May 25 15:46:11.982360 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-cc9ec7cc-45c6-4719-969c-da83f7272847 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301394 May 25 15:46:12.119959 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a9efe63-4953-4806-a57d-05893747c45f req-cb27a317-3564-47c0-a4b0-7c87a2c86418 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269476 May 25 15:46:12.523867 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:12.527772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:12.653336 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:12.700668 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Floating IP f9ed1275-5b92-458a-954d-b946214efa9e associated. External IP: 172.27.0.42, port: a7d32eab-b1e5-4dcd-bb06-5f06e6841586. May 25 15:46:12.907755 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-22ce12f2-aef3-49c1-b0ac-e619b9e3f637 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:12.908478 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-617af95d-9045-4837-99f6-c1c2ee993045 req-22ce12f2-aef3-49c1-b0ac-e619b9e3f637 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:network {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:46:12.925254 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-617af95d-9045-4837-99f6-c1c2ee993045 req-22ce12f2-aef3-49c1-b0ac-e619b9e3f637 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:network {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:46:12.926485 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-22ce12f2-aef3-49c1-b0ac-e619b9e3f637 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 813 time: 0.1642694 May 25 15:46:12.941250 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-21dc0ad9-d9e6-4a00-ae8e-639f41f276c6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/quotas/fd3e84780cc8404caa2bc8b9b90bcfab HTTP/1.1" status: 200 len: 375 time: 0.0089824 May 25 15:46:12.990036 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-f1d73f2c-55cd-4a0b-8a4f-82817b58bcc9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0434132 May 25 15:46:13.053083 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:46:13.122383 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-f84a732a-f609-48a4-ba80-26ac8d54296d service neutron] 10.222.0.36 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257355 May 25 15:46:13.257546 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-ceed48a2-b59a-460f-b495-a989baba6be0 service neutron] 10.222.0.36 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290786 May 25 15:46:13.349590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:46:13.362883 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:13.365567 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:46:13.375049 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:46:13.375682 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:46:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:13.461939 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a0db084f-0b92-4fe2-a15d-ba1adce04822 req-2221dd92-9172-47fd-b8f8-eb60a17e3fc2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 210 time: 0.0588269 May 25 15:46:13.475956 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-984117ab-a8d1-4067-8d24-5ec4ef4462c1 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "PUT /v2.0/floatingips/f9ed1275-5b92-458a-954d-b946214efa9e HTTP/1.1" status: 200 len: 990 time: 1.7321715 May 25 15:46:13.475956 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:13.547065 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'status': 'completed', 'code': 200} May 25 15:46:13.574344 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:46:13.715722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338e4455-ac2f-451a-906e-402220c58497 req-12e88d6f-b9b1-4180-ab9d-3165a16078e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:13.717230 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-12e88d6f-b9b1-4180-ab9d-3165a16078e4 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 1098 time: 0.1168303 May 25 15:46:13.863225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338e4455-ac2f-451a-906e-402220c58497 req-60aef6fc-4ad8-499a-9c2d-123a3244d1f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:13.865221 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-60aef6fc-4ad8-499a-9c2d-123a3244d1f1 service neutron] 10.222.0.70 "GET /v2.0/networks?id=320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 200 len: 912 time: 0.1382692 May 25 15:46:13.954969 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'f9ed1275-5b92-458a-954d-b946214efa9e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.42', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:a3:cb:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b093877-20ab-4678-8d94-a89983bda325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:57Z', 'updated_at': '2021-05-25T15:46:12Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:13.958924 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:46:13.967228 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:46:13.967876 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:46:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:13.982801 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-5d61b168-f5b7-4f03-9689-0312b42610ba service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586 HTTP/1.1" status: 200 len: 998 time: 0.1061535 May 25 15:46:14.056168 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338e4455-ac2f-451a-906e-402220c58497 req-68772c32-9807-4c19-b761-e7fbba948e8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:14.057567 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-68772c32-9807-4c19-b761-e7fbba948e8a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 200 len: 850 time: 0.0600853 May 25 15:46:14.144509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-338e4455-ac2f-451a-906e-402220c58497 req-a711f6da-1abd-4053-843b-6146560817a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:14.146086 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-a711f6da-1abd-4053-843b-6146560817a4 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=320ad3f5-0f83-444c-8df0-70303c7a4446&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0781169 May 25 15:46:14.149350 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:46:14.376329 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-ae356819-2958-4c52-a24e-da7edf8870ae service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2191737 May 25 15:46:14.501847 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'f9ed1275-5b92-458a-954d-b946214efa9e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.42', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:a3:cb:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b093877-20ab-4678-8d94-a89983bda325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:57Z', 'updated_at': '2021-05-25T15:46:12Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:14.506831 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5b64d8d4-e944-4b4e-bb80-132fe55722a0 None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': 'f9ed1275-5b92-458a-954d-b946214efa9e', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'floating_ip_address': '172.27.0.42', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'port_id': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 547, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'mac_address': 'fa:16:3e:a3:cb:86', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b093877-20ab-4678-8d94-a89983bda325', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:45:57Z', 'updated_at': '2021-05-25T15:46:12Z', 'revision_number': 1, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:46:14.523424 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-338e4455-ac2f-451a-906e-402220c58497 req-22fc7894-ba09-4bee-8cd3-4e8e1e18f897 service neutron] 10.222.0.70 "GET /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1357701 May 25 15:46:14.704951 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca789142-ac27-4044-bd26-80589d8758d1 req-5824b588-2a69-4a01-952e-a4e6f3de4614 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 210 time: 0.1099429 May 25 15:46:14.779231 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e951bfbb-fe61-4ee8-8b7b-2edfb5076df8 None None] New status for floating IP f9ed1275-5b92-458a-954d-b946214efa9e: ACTIVE {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:46:14.796532 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-1aa6233f-9892-4337-ac7d-c16fdc1d9243 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:14.800580 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-1aa6233f-9892-4337-ac7d-c16fdc1d9243 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 813 time: 0.2275336 May 25 15:46:14.820144 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Request body: {'port': {'device_id': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236', 'admin_state_up': True, 'tenant_id': 'fd3e84780cc8404caa2bc8b9b90bcfab'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:14.962899 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:46:14.966705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Usage tracker for resource:port and tenant:fd3e84780cc8404caa2bc8b9b90bcfab is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:46:14.969500 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:46:14.975757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:46:14.985738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Made reservation on behalf of fd3e84780cc8404caa2bc8b9b90bcfab for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:46:14.989298 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:15.160160 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Allocated IP 172.20.0.6 (3c515845-6e63-4d8b-b829-eb7af03f0236/cc10550a-268b-4838-b7df-f6dc84fd8286/95018903-b76e-4499-90aa-6e8e90060c3c) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:46:15.358831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:15.391473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:15.401490 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-70589021-62d4-49ea-9a89-32017056630e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:15.465161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:46:15.468194 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:46:15.472141 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:46:15.517095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Pushing event updated for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:15.521573 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:15.538528 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:15.539136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:15.558956 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7432685 May 25 15:46:15.571200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Request body: {'port': {'device_id': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:46:15.674245 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:46:15.679326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:15.906611 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b0362bc-2ca8-4263-b020-896b90f6eae4 req-7462d946-f3c4-46e9-8799-bcf12bbb2b80 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:15.908669 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9b0362bc-2ca8-4263-b020-896b90f6eae4 req-7462d946-f3c4-46e9-8799-bcf12bbb2b80 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 931 time: 0.0868359 May 25 15:46:15.957331 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9b0362bc-2ca8-4263-b020-896b90f6eae4 req-5415486a-c1d1-4e5b-bf9c-4ac0cbed18a9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425131 May 25 15:46:16.063206 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 95018903-b76e-4499-90aa-6e8e90060c3c {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:46:16.071443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:16.086492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Transition to ACTIVE for port object 95018903-b76e-4499-90aa-6e8e90060c3c will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:46:16.089599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:16.093138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.376696 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Pushing event updated for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:16.382043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.423313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Attempting to bind port 95018903-b76e-4499-90aa-6e8e90060c3c on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:46:16.423641 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Attempting to bind port 95018903-b76e-4499-90aa-6e8e90060c3c by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:46:16.423993 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Attempting to bind port 95018903-b76e-4499-90aa-6e8e90060c3c on network 3c515845-6e63-4d8b-b829-eb7af03f0236 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:46:16.428606 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Port 95018903-b76e-4499-90aa-6e8e90060c3c on network 3c515845-6e63-4d8b-b829-eb7af03f0236 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:46:16.428919 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Attempting to bind port 95018903-b76e-4499-90aa-6e8e90060c3c on network 3c515845-6e63-4d8b-b829-eb7af03f0236 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:46:16.433920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 46, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:46:16.434255 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Checking segment: {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:46:16.434637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Bound using segment: {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:46:16.435056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Bound port: 95018903-b76e-4499-90aa-6e8e90060c3c, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:46:16.435398 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:16.526604 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:46:16.529516 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=95018903-b76e-4499-90aa-6e8e90060c3c,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:46:16.534052 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:16.538302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a6944444-40f6-4521-9cda-140137adadb5 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:16.591705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:16.592339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:16.593676 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] 10.222.0.70 "PUT /v2.0/ports/95018903-b76e-4499-90aa-6e8e90060c3c HTTP/1.1" status: 200 len: 1093 time: 1.0264087 May 25 15:46:16.594164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:16.614396 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Pushing event updated for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:16.617667 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:16.642829 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c', 'status': 'completed', 'code': 200} May 25 15:46:16.734829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-3fca9525-01ea-440c-8499-39cabcb1589f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:16.736477 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-3fca9525-01ea-440c-8499-39cabcb1589f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 1096 time: 0.0735874 May 25 15:46:16.808252 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-8fe2e8e2-d16d-4d64-8bab-d28021af99aa service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=95018903-b76e-4499-90aa-6e8e90060c3c HTTP/1.1" status: 200 len: 217 time: 0.0605915 May 25 15:46:16.879350 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617af95d-9045-4837-99f6-c1c2ee993045 req-086ed359-8a76-4b03-a438-14dce1328e78 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:16.880810 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-086ed359-8a76-4b03-a438-14dce1328e78 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cc10550a-268b-4838-b7df-f6dc84fd8286 HTTP/1.1" status: 200 len: 853 time: 0.0613191 May 25 15:46:16.934356 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-7b213f82-c393-495b-83e4-59a5b12686d3 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=3c515845-6e63-4d8b-b829-eb7af03f0236&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0399070 May 25 15:46:17.080374 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-befed31b-9b76-4fa4-b3c6-7fc6498c20b3 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1301074 May 25 15:46:17.149325 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0082e9-af78-4aa3-8a73-1b386d35515b req-33bd709b-84e3-4467-9a0f-ea426fb4e32e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:17.150848 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5d0082e9-af78-4aa3-8a73-1b386d35515b req-33bd709b-84e3-4467-9a0f-ea426fb4e32e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 943 time: 0.0835922 May 25 15:46:17.196141 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5d0082e9-af78-4aa3-8a73-1b386d35515b req-738317c6-262b-484d-bb40-9ae398e8387a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390182 May 25 15:46:17.235001 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617af95d-9045-4837-99f6-c1c2ee993045 req-32f7fc0a-31f7-4e43-8e70-4ab6a472ed4e service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1321962 May 25 15:46:17.364294 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-a2864d8b-22e4-498f-80ec-228d0cabc866 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:17.365803 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-a2864d8b-22e4-498f-80ec-228d0cabc866 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 1096 time: 0.0716264 May 25 15:46:17.516575 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-0aba6531-7852-4348-8bdf-7141e9578cf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:17.518023 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-0aba6531-7852-4348-8bdf-7141e9578cf2 service neutron] 10.222.0.70 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 914 time: 0.1375177 May 25 15:46:17.598620 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-39f66f8c-e53c-4126-8d14-7029b8669352 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=95018903-b76e-4499-90aa-6e8e90060c3c HTTP/1.1" status: 200 len: 217 time: 0.0651031 May 25 15:46:17.666852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-19da2710-e5a4-4825-86d1-5730003e6d84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:17.668284 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-19da2710-e5a4-4825-86d1-5730003e6d84 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cc10550a-268b-4838-b7df-f6dc84fd8286 HTTP/1.1" status: 200 len: 853 time: 0.0624361 May 25 15:46:17.715382 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-5631b379-84fc-4325-9395-940d1ea98eb6 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=3c515845-6e63-4d8b-b829-eb7af03f0236&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0397146 May 25 15:46:17.858473 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-97b5b8cc-fbf4-4251-8566-e058dfd22214 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353781 May 25 15:46:18.073698 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-108f951f-2466-4d2b-9501-55bdc4a96cf8 req-093feaf2-8138-42c3-95e6-7a33fa68ac80 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2074816 May 25 15:46:18.384211 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-99b22046-a557-4353-84cc-7c7f871990b4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:18.384913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-99b22046-a557-4353-84cc-7c7f871990b4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:46:18.403591 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-99b22046-a557-4353-84cc-7c7f871990b4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:46:18.404773 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-99b22046-a557-4353-84cc-7c7f871990b4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 943 time: 0.1009135 May 25 15:46:18.449457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-cf107571-de6a-4cc3-aee5-aab93102a113 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:security_group {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:46:18.465060 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-cf107571-de6a-4cc3-aee5-aab93102a113 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:security_group {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:46:18.466350 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c1782d9e-0ebb-4892-922c-b2d9b3a10bf2 req-cf107571-de6a-4cc3-aee5-aab93102a113 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0560615 May 25 15:46:19.174527 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 95018903-b76e-4499-90aa-6e8e90060c3c details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:46:19.345840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=95018903-b76e-4499-90aa-6e8e90060c3c,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:19.359189 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '95018903-b76e-4499-90aa-6e8e90060c3c', 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236', 'port_id': '95018903-b76e-4499-90aa-6e8e90060c3c', 'mac_address': 'fa:16:3e:5c:43:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc10550a-268b-4838-b7df-f6dc84fd8286', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:46:19.419875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:19.438358 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 95018903-b76e-4499-90aa-6e8e90060c3c {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:46:19.455694 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=95018903-b76e-4499-90aa-6e8e90060c3c,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:19.460261 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:19.462077 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:19.531830 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:19.535007 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:19.661102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 req-07a9c1c1-35bb-492d-a582-475ebc7b2ccc tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:19.662619 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 req-07a9c1c1-35bb-492d-a582-475ebc7b2ccc tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 944 time: 0.0822091 May 25 15:46:19.706800 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d36b05e6-bbf9-4b69-ac06-43e0d941a5e5 req-8749e296-1fcd-4393-9ca9-fe7830a10cb0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386684 May 25 15:46:19.905524 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['95018903-b76e-4499-90aa-6e8e90060c3c'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:46:20.894312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617f25da-62a4-465c-843a-928bd68a8681 req-a673438a-c5b5-41ca-b0fd-4ee9ab5f0210 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:20.895765 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617f25da-62a4-465c-843a-928bd68a8681 req-a673438a-c5b5-41ca-b0fd-4ee9ab5f0210 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 944 time: 0.0837989 May 25 15:46:20.939086 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-617f25da-62a4-465c-843a-928bd68a8681 req-f95c6b05-0b79-4515-ac80-4ace0d97834f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377541 May 25 15:46:21.185503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 95018903-b76e-4499-90aa-6e8e90060c3c up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:46:21.251681 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 95018903-b76e-4499-90aa-6e8e90060c3c completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:46:21.256039 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 95018903-b76e-4499-90aa-6e8e90060c3c triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:46:21.256417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:21.369371 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:21.396321 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:21.405484 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=95018903-b76e-4499-90aa-6e8e90060c3c,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:21.409862 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:21.411750 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:21.446729 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c', 'code': 200} May 25 15:46:21.478884 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:21.482672 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:21.721832 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63c9b0f-1eaf-4e71-bfb3-30850f0c5323 req-b3f3947a-b4ed-48b9-9f45-6800c54c6ae1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:21.723219 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b63c9b0f-1eaf-4e71-bfb3-30850f0c5323 req-b3f3947a-b4ed-48b9-9f45-6800c54c6ae1 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 1098 time: 0.0684109 May 25 15:46:21.780495 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b63c9b0f-1eaf-4e71-bfb3-30850f0c5323 req-310fbcb3-f94e-485b-92c6-f136e833a3a3 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367725 May 25 15:46:22.122853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6955f202-e743-47ee-ac57-f1b1578e3417 req-0bfdbc60-485c-4513-a2bf-d38d3e3a7ef2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:22.124334 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6955f202-e743-47ee-ac57-f1b1578e3417 req-0bfdbc60-485c-4513-a2bf-d38d3e3a7ef2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.0797920 May 25 15:46:22.169501 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6955f202-e743-47ee-ac57-f1b1578e3417 req-bffcef5e-fd38-4a04-877f-948cce60e4cb tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394442 May 25 15:46:23.359680 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c04ad00-2586-448b-843b-1e0876e56ca9 req-d3daec0c-8668-481a-ab94-57f518cd7f58 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:23.361173 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3c04ad00-2586-448b-843b-1e0876e56ca9 req-d3daec0c-8668-481a-ab94-57f518cd7f58 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.0842617 May 25 15:46:23.406258 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3c04ad00-2586-448b-843b-1e0876e56ca9 req-783d50d9-cc33-40ac-8ad6-53fde988650b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395107 May 25 15:46:29.973447 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-158787ff-f8f3-40b5-ae7a-0fa6e7abd1ca None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:32.629102 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:32.684617 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-02789af4-af47-4e0d-a67a-3572b92b3efd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:33.456239 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:35.173204 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:42.655288 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:51.535779 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd94fb8f-70b8-4c86-b403-811e878a5141 req-636a041f-d4b0-43c0-bdeb-5ba68b5ca72c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:51.536374 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd94fb8f-70b8-4c86-b403-811e878a5141 req-636a041f-d4b0-43c0-bdeb-5ba68b5ca72c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0817337 May 25 15:46:51.584231 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd94fb8f-70b8-4c86-b403-811e878a5141 req-5aec9c19-2774-4210-bfb6-139524102961 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416238 May 25 15:46:52.675416 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:46:52.774633 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f637d1d0-c3be-4564-87ac-8e40939995a4 req-84be9a35-68e5-4d81-aa41-6d93a62a05d2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:52.776087 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f637d1d0-c3be-4564-87ac-8e40939995a4 req-84be9a35-68e5-4d81-aa41-6d93a62a05d2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0829380 May 25 15:46:52.821032 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f637d1d0-c3be-4564-87ac-8e40939995a4 req-6d62f392-a994-451c-9a09-3c4ffdfc923d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393941 May 25 15:46:53.757161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-e1b792be-1c09-4837-9d14-cfd328d3e4ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:53.759296 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-e1b792be-1c09-4837-9d14-cfd328d3e4ce tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.0801764 May 25 15:46:53.940302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:46:53.940953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:54.051976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 req-b0e2aef6-06bf-40ff-8fc1-45ce84f67147 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:46:54.053461 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 req-b0e2aef6-06bf-40ff-8fc1-45ce84f67147 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 945 time: 0.1191087 May 25 15:46:54.081968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] For port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:46:54.082326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:54.097410 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1c6d7cf6-f2f2-470f-b556-91560a4c8ea0 req-688c58f0-f1a2-401d-abb2-44136408eafa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375600 May 25 15:46:54.386310 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:54.386635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:54.386945 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4 disassociated. External IP: 172.27.0.111, port: 746ae7a8-06cf-478c-b6d4-ecf4e9c02988. May 25 15:46:54.387306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:46:54.510978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:54.519241 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-965ab136-ceae-42bb-839e-66bc622225bc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:46:54.564611 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=746ae7a8-06cf-478c-b6d4-ecf4e9c02988,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:46:54.568312 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:46:54.757347 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:46:55.041417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:46:55.055199 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:46:55.069823 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:46:55.070873 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:46:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:55.121133 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] No DVR routers for this DVR port 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:46:55.124956 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:46:55.128447 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'name': 'network-vif-deleted', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:46:55.169661 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e5189bf-9444-4420-8805-66570b1bdf78 req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "DELETE /v2.0/ports/746ae7a8-06cf-478c-b6d4-ecf4e9c02988 HTTP/1.1" status: 204 len: 173 time: 1.3719270 May 25 15:46:55.237389 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4cd52975-28c3-4fb7-ada2-905a8a9c571f', 'name': 'network-vif-deleted', 'tag': '746ae7a8-06cf-478c-b6d4-ecf4e9c02988', 'status': 'completed', 'code': 200} May 25 15:46:55.280679 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-17c105aa-95b1-4a82-9019-58a70ab1f437 req-f46a407f-6a12-4fdf-b444-d4e30da679de tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0584648 May 25 15:46:55.295326 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:46:55.615553 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:55.619365 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:46:55.627654 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:46:55.628298 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:46:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:55.812888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:46:56.159018 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:46:56.162857 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d3b728b-28b6-4f00-87f1-8fe239135882 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:46:56.367794 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4825e474-2463-4176-96e8-7903d3f3d8c1 None None] New status for floating IP fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:46:56.445905 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2d5509e6-fead-47a7-9b95-c77f7b471838 req-1156663c-63b5-4377-a9bd-1fc77225da63 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0465212 May 25 15:46:57.606319 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4cd385b0-3a1f-41b9-9293-37870b43da0a req-20e209af-64f0-485c-b00c-1ba3588a5dc8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0438910 May 25 15:46:58.576633 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:46:58.611242 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:46:58.611598 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 746ae7a8-06cf-478c-b6d4-ecf4e9c02988 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:46:58.765719 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8b81beeb-d0ae-43a2-a0a6-51aa24f2ed19 req-ed141ea4-7b7a-48cb-a165-fe013ec08daa tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0431819 May 25 15:46:59.932382 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-329c4a07-c64c-41e2-ac6c-9e9718279a45 req-12051564-0383-40c5-a93c-606214f048cb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=4cd52975-28c3-4fb7-ada2-905a8a9c571f HTTP/1.1" status: 200 len: 210 time: 0.0469611 May 25 15:46:59.966021 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1ac31994-75b9-460c-937f-fb80539f6532 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:00.715204 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 req-5cf03090-9ee6-48a4-93b6-9808ed6fe8a2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:00.716721 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 req-5cf03090-9ee6-48a4-93b6-9808ed6fe8a2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0840650 May 25 15:47:00.760129 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd1c38f2-f45e-4abd-9a6e-02d18756da22 req-a9f46eeb-656a-4bd2-804e-686d21f30c6b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378804 May 25 15:47:01.283764 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-c8049ab4-f0b0-420e-9aaf-e30345e9c4f1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1147553235&fields=id&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 267 time: 0.0400031 May 25 15:47:01.434958 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f9bbfa57-0d2f-4c45-a272-76c9940a0711 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:01.436434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f9bbfa57-0d2f-4c45-a272-76c9940a0711 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.1465077 May 25 15:47:01.451552 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-03c4f1af-e495-47ff-a3ca-58d2c1b7716b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/quotas/8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 375 time: 0.0097837 May 25 15:47:01.533163 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-85a708b1-90cd-449c-9df4-011e26b28706 req-db068ddf-5421-48f4-9a09-2cb8a0226b65 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:47:01.548222 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-85a708b1-90cd-449c-9df4-011e26b28706 req-db068ddf-5421-48f4-9a09-2cb8a0226b65 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:47:01.549627 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-db068ddf-5421-48f4-9a09-2cb8a0226b65 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0930870 May 25 15:47:01.687608 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-0c836a9b-298b-45a3-a241-0aa78c7afe8f service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1261768 May 25 15:47:01.820044 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-bcf6b4ea-791f-4a32-9d1a-1574e6f4edc2 service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265414 May 25 15:47:01.961515 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27aba94e-7aea-4018-87d5-ceeedc41d612 req-edfdf02d-1e79-40e8-8d92-144fa279cf41 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:01.962980 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-27aba94e-7aea-4018-87d5-ceeedc41d612 req-edfdf02d-1e79-40e8-8d92-144fa279cf41 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0837812 May 25 15:47:02.009060 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-27aba94e-7aea-4018-87d5-ceeedc41d612 req-1bf35eb1-88a7-48be-8fad-bd822e43ca12 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395405 May 25 15:47:02.222235 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-abadc807-089f-4144-bf3f-512bab7eb45d req-08b4c33a-30fd-4d0a-988a-0348009def6c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 210 time: 0.0473278 May 25 15:47:02.632295 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:02.685842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7fc09e0e-b901-4a0a-9141-b88d30a2623f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:03.203410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c19b678-ed05-4c96-9d08-0cff64255b29 req-4049d26f-70dd-4d29-99c2-87f05905e8ae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:03.204887 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4c19b678-ed05-4c96-9d08-0cff64255b29 req-4049d26f-70dd-4d29-99c2-87f05905e8ae tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0799215 May 25 15:47:03.248594 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4c19b678-ed05-4c96-9d08-0cff64255b29 req-3f7a9de1-88c1-4b06-bb43-4de39bcce4f8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380678 May 25 15:47:03.386191 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8d35b825-68c5-41e4-ac91-f7a19a8f4f9c req-989b46da-de9d-4fe8-a0d7-783ca4d4ca1d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 210 time: 0.0429459 May 25 15:47:03.456255 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:04.441412 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c req-f9f5ea07-2263-43a2-8b57-e86195e164fd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:04.442812 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c req-f9f5ea07-2263-43a2-8b57-e86195e164fd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0877473 May 25 15:47:04.486602 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-48a06ba7-6b5c-4a71-bed3-21f5a7ec144c req-04d02d09-f34e-468c-9bfb-337f2c43220f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381103 May 25 15:47:04.622514 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-271500c2-3762-413c-9101-884405113ced req-54095e6a-4b86-4515-b873-2ffd0a67e2f9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 210 time: 0.0428743 May 25 15:47:05.175216 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:05.683711 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 req-c7b18af3-8125-4584-bb80-9658aad68117 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:05.685219 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 req-c7b18af3-8125-4584-bb80-9658aad68117 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0850377 May 25 15:47:05.730452 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2f4f1aba-140c-40b0-9a74-8f9ebef9f176 req-0bc8d1ed-5f64-4703-8ef8-65d2f68e357c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394225 May 25 15:47:05.770971 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ef62e420-20a3-4af2-8399-3981cafc920f req-269aef6b-38eb-4dae-80d1-3ae0c029a238 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 210 time: 0.0422897 May 25 15:47:06.048405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-2e6dfc55-5cbf-48ab-b3cf-84cab6bac1eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:06.049867 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-2e6dfc55-5cbf-48ab-b3cf-84cab6bac1eb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.1450760 May 25 15:47:06.106300 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-32f2a4f4-d9ac-4887-96c0-1914ea87c1ba tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 380 time: 0.0428357 May 25 15:47:06.116868 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'port': {'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'admin_state_up': True, 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'security_groups': ['1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:47:06.257618 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:47:06.270581 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:47:06.281301 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Made reservation on behalf of 8dff1003ceba47f6a75b4c3901343b7b for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:47:06.284959 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:06.540118 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.20.0.13 (d8a04926-b628-40fa-a53b-51df7783813d/693414b7-eaf3-4626-b7cd-b644e55f5f70/241b07d8-fed4-43ac-a7e1-530b98daf731) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:47:06.724212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:06.739434 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Transition to ACTIVE for port object 241b07d8-fed4-43ac-a7e1-530b98daf731 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:47:06.763198 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:06.768956 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:06.846622 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:06.853334 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:47:06.857417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:47:06.860043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.860410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.860951 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.861466 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.861996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.862505 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.863012 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.863515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.864470 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.864470 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.864740 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.865092 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:06.868141 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:47:06.899761 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:06.939440 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1464028c-fb82-4e29-9107-90d3a72cbcc0 req-9a7d23a5-a037-4f63-9688-f55fb96ebc80 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:06.947347 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1464028c-fb82-4e29-9107-90d3a72cbcc0 req-9a7d23a5-a037-4f63-9688-f55fb96ebc80 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.1011386 May 25 15:47:06.988965 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1464028c-fb82-4e29-9107-90d3a72cbcc0 req-02fa98ae-357b-46c9-93b2-c4dcfaff4904 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407476 May 25 15:47:06.991065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:06.991705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:07.027135 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9141510 May 25 15:47:07.035671 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1777a09f-20ea-4735-9acb-1a9d1918cade req-499f017e-b133-4f0f-a0f5-4c3ffa5e4837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:07.036415 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-1777a09f-20ea-4735-9acb-1a9d1918cade req-499f017e-b133-4f0f-a0f5-4c3ffa5e4837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:47:07.054758 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-1777a09f-20ea-4735-9acb-1a9d1918cade req-499f017e-b133-4f0f-a0f5-4c3ffa5e4837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:47:07.056026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1777a09f-20ea-4735-9acb-1a9d1918cade req-499f017e-b133-4f0f-a0f5-4c3ffa5e4837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 932 time: 0.1603954 May 25 15:47:07.101433 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1777a09f-20ea-4735-9acb-1a9d1918cade req-80edb3ef-aa95-44bd-a01a-b4e7d64c6b54 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394130 May 25 15:47:07.109918 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-572010a0-0fdc-4b7b-a89f-e8cb9474b629 None None] Provisioning for port 241b07d8-fed4-43ac-a7e1-530b98daf731 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:47:07.114771 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-572010a0-0fdc-4b7b-a89f-e8cb9474b629 None None] Provisioning complete for port 241b07d8-fed4-43ac-a7e1-530b98daf731 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:47:07.115222 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-572010a0-0fdc-4b7b-a89f-e8cb9474b629 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:07.168074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-572010a0-0fdc-4b7b-a89f-e8cb9474b629 None None] Port 241b07d8-fed4-43ac-a7e1-530b98daf731 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:47:08.182860 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14797394-125d-439b-9306-6e60eef7f911 req-45b73130-d801-4c15-9982-f32fe46855bf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:08.184261 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-14797394-125d-439b-9306-6e60eef7f911 req-45b73130-d801-4c15-9982-f32fe46855bf tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0799620 May 25 15:47:08.227119 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-14797394-125d-439b-9306-6e60eef7f911 req-5c46313d-28f2-4d05-876d-500537f8f2d3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371861 May 25 15:47:08.406105 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-120cdbbd-63e2-4ae1-b006-ddc9a093638f req-ab2cb82a-e9c5-44bf-b6cd-64eb85e26837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:08.407575 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-120cdbbd-63e2-4ae1-b006-ddc9a093638f req-ab2cb82a-e9c5-44bf-b6cd-64eb85e26837 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 932 time: 0.0838189 May 25 15:47:08.453214 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-120cdbbd-63e2-4ae1-b006-ddc9a093638f req-9e3ce907-6102-445b-8346-63c4897a078a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396776 May 25 15:47:09.416556 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950e2083-82bf-4c7e-8031-9090d03456c5 req-d3b9f158-e8c0-43a7-977f-87d9edadafc7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:09.418027 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-950e2083-82bf-4c7e-8031-9090d03456c5 req-d3b9f158-e8c0-43a7-977f-87d9edadafc7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0811822 May 25 15:47:09.467203 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-950e2083-82bf-4c7e-8031-9090d03456c5 req-b02f47fe-a956-4c7d-a28d-b513a43a46f7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435910 May 25 15:47:09.644750 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfba457a-5602-47ba-accd-1c0d55ffcead req-b0d56dbf-f511-43b5-b0c7-022aa21243e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:09.646243 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dfba457a-5602-47ba-accd-1c0d55ffcead req-b0d56dbf-f511-43b5-b0c7-022aa21243e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 932 time: 0.0789585 May 25 15:47:09.689982 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dfba457a-5602-47ba-accd-1c0d55ffcead req-09477250-cc2a-4d21-8dd8-b1a6019cb5d0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380199 May 25 15:47:10.120004 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Request body: {'port': {'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:47:10.235877 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:10.637263 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 241b07d8-fed4-43ac-a7e1-530b98daf731 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:47:10.647112 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:10.669333 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Transition to ACTIVE for port object 241b07d8-fed4-43ac-a7e1-530b98daf731 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:47:10.672793 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:10.678548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2fc87ca5-e938-46b1-b2bb-30b05a5ead2e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:10.861986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d req-c224a529-895e-4702-99e8-83ccb00e8d7f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:10.863567 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d req-c224a529-895e-4702-99e8-83ccb00e8d7f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.2858047 May 25 15:47:10.870062 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Pushing event updated for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:10.904572 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11903f6c-00bb-43ea-9cc8-7e3ed101293c req-3368f383-41e3-45db-a785-909fa98c2376 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:10.906430 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11903f6c-00bb-43ea-9cc8-7e3ed101293c req-3368f383-41e3-45db-a785-909fa98c2376 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.1018252 May 25 15:47:10.909580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:10.956065 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-11903f6c-00bb-43ea-9cc8-7e3ed101293c req-569444d5-cadb-4d53-91db-1d071525c626 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430579 May 25 15:47:11.071312 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7d0f2054-580c-4fb3-97f5-ffc6e6dc2e1d req-a6234496-861f-4593-81f3-5ae733633615 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1983786 May 25 15:47:11.079978 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Attempting to bind port 241b07d8-fed4-43ac-a7e1-530b98daf731 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:47:11.080315 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Attempting to bind port 241b07d8-fed4-43ac-a7e1-530b98daf731 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:47:11.080647 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Attempting to bind port 241b07d8-fed4-43ac-a7e1-530b98daf731 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:47:11.085391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Port 241b07d8-fed4-43ac-a7e1-530b98daf731 on network d8a04926-b628-40fa-a53b-51df7783813d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:47:11.085759 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Attempting to bind port 241b07d8-fed4-43ac-a7e1-530b98daf731 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:47:11.090921 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 46, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:47:11.091265 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:47:11.091645 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Bound using segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:47:11.092864 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Bound port: 241b07d8-fed4-43ac-a7e1-530b98daf731, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:47:11.093225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:11.187765 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:47:11.192011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=241b07d8-fed4-43ac-a7e1-530b98daf731,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:47:11.196474 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:11.201305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:11.256188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:11.256818 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:11.258242 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] 10.222.0.70 "PUT /v2.0/ports/241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 1094 time: 1.1427584 May 25 15:47:11.261221 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:11.287785 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Pushing event updated for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:11.292990 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:11.315167 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'status': 'completed', 'code': 200} May 25 15:47:11.404198 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-0e56edac-e740-431d-be9f-09c143cdab16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:11.405687 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-0e56edac-e740-431d-be9f-09c143cdab16 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1097 time: 0.0745182 May 25 15:47:11.486165 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-e5753e95-979f-49bb-82ac-d51c42995f7e service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 217 time: 0.0652862 May 25 15:47:11.552383 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-9850d508-8b22-4212-a06a-aa636000efdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:11.553960 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-9850d508-8b22-4212-a06a-aa636000efdd service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0591021 May 25 15:47:11.636916 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a708b1-90cd-449c-9df4-011e26b28706 req-e66366d9-69e6-45e8-8168-e72f8fa0b1f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:11.638410 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-e66366d9-69e6-45e8-8168-e72f8fa0b1f6 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0729778 May 25 15:47:11.772496 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-e01d76a0-8a2d-4cb0-ad7d-17ed6d879282 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1252360 May 25 15:47:11.911298 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-85a708b1-90cd-449c-9df4-011e26b28706 req-d38ac604-3b34-4758-bf06-19ee2d2dfbb0 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271551 May 25 15:47:12.037675 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-52cb56aa-d919-46d2-9a07-7fd979e8b3c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.039213 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-52cb56aa-d919-46d2-9a07-7fd979e8b3c1 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1097 time: 0.0735292 May 25 15:47:12.237348 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-578446fd-26a5-4c57-b86a-479ecf97afb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.238786 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-578446fd-26a5-4c57-b86a-479ecf97afb1 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1865070 May 25 15:47:12.250657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7577104-5a8c-41e2-b9a3-91baa24bff04 req-3837ee3f-12d0-4e08-baa3-e0d185773bd9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.252055 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c7577104-5a8c-41e2-b9a3-91baa24bff04 req-3837ee3f-12d0-4e08-baa3-e0d185773bd9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.1798196 May 25 15:47:12.278506 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ff1353-3e29-4278-93fb-2f4c34f15935 req-70099492-f4ba-4f74-b050-e3702cc47345 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.279998 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f7ff1353-3e29-4278-93fb-2f4c34f15935 req-70099492-f4ba-4f74-b050-e3702cc47345 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0841713 May 25 15:47:12.324507 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f7ff1353-3e29-4278-93fb-2f4c34f15935 req-5afdf39b-2516-42a6-9676-8eb9669f40e1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388093 May 25 15:47:12.332028 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-9de928b3-dd5b-451d-8ad5-d118796540eb service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 217 time: 0.0790329 May 25 15:47:12.394822 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c7577104-5a8c-41e2-b9a3-91baa24bff04 req-111e8ec6-fd0b-452f-920f-101e28ea18c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0955925 May 25 15:47:12.413572 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-b1d9c56f-777a-4073-8298-9cc05a24d9da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.414997 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-b1d9c56f-777a-4073-8298-9cc05a24d9da service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0689447 May 25 15:47:12.499585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-99a6169c-c16b-4308-ae78-942a99c63640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:12.502141 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-99a6169c-c16b-4308-ae78-942a99c63640 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0752397 May 25 15:47:12.641943 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-3abd0d9e-391b-4f42-aea1-2daa76b44cf9 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1279848 May 25 15:47:12.653503 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:12.776044 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb580588-8f6f-4c92-aa9e-de3b99d84396 req-92f236cf-bef3-41bc-a6ef-8b308069eb5f service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263101 May 25 15:47:13.174679 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-c320c4a2-9895-41fe-ab07-3655ddeac538 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1597619 May 25 15:47:13.330276 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8563b3dc-6696-4740-b265-623145c50d3c req-d9e31671-79d7-4b30-b8a6-6cae357f7c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.331733 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-d9e31671-79d7-4b30-b8a6-6cae357f7c0d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.0700388 May 25 15:47:13.541998 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8563b3dc-6696-4740-b265-623145c50d3c req-5be43eb8-d929-4620-807a-33a175004029 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.543453 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-5be43eb8-d929-4620-807a-33a175004029 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.1848059 May 25 15:47:13.564310 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b req-63cbaa07-8359-47af-8e96-bad1fc2f8e40 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.565737 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b req-63cbaa07-8359-47af-8e96-bad1fc2f8e40 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.1224892 May 25 15:47:13.582023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83d28378-6186-48be-bbf3-4260cc5d7012 req-8e8f8ebe-7438-44c1-8dea-6ad021b2e6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.583934 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-83d28378-6186-48be-bbf3-4260cc5d7012 req-8e8f8ebe-7438-44c1-8dea-6ad021b2e6da tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0799861 May 25 15:47:13.635329 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-83d28378-6186-48be-bbf3-4260cc5d7012 req-57ffb58f-2688-422b-b05f-1036b8f592b4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456338 May 25 15:47:13.696954 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-97ac00ef-3c9b-4b70-9500-12c1ea4e5c2b req-8362a74b-766c-43b2-8c14-b7239979bff3 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722396 May 25 15:47:13.698685 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-c5eda6b8-2822-4880-9d2b-2940f56eaca4 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1002 time: 0.1430879 May 25 15:47:13.772068 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8563b3dc-6696-4740-b265-623145c50d3c req-ce6ff0eb-377e-4d6f-b0cc-bb07a03f49bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.773512 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-ce6ff0eb-377e-4d6f-b0cc-bb07a03f49bc service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0599751 May 25 15:47:13.865276 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8563b3dc-6696-4740-b265-623145c50d3c req-7aac26fe-1531-4e95-9afa-aadedaf6b235 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:13.866736 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-7aac26fe-1531-4e95-9afa-aadedaf6b235 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0723646 May 25 15:47:14.008733 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-c1f56ca0-6fc8-4f8e-bc38-9a5135d75ed7 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248784 May 25 15:47:14.149770 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8563b3dc-6696-4740-b265-623145c50d3c req-23d45a5a-6358-481e-bf4c-a34efafd6fb5 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281993 May 25 15:47:14.818699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17545450-3945-45c2-89c8-7f52e09c653e req-9926c18d-bf43-4bf2-8aea-490ff630138d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:14.820576 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-17545450-3945-45c2-89c8-7f52e09c653e req-9926c18d-bf43-4bf2-8aea-490ff630138d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0818596 May 25 15:47:14.870379 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-17545450-3945-45c2-89c8-7f52e09c653e req-ba35048c-faa9-4afd-82d1-e80a4b2319a7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437868 May 25 15:47:14.890125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 req-c2f591e8-749f-45d0-b535-1a828eead82e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:14.891610 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 req-c2f591e8-749f-45d0-b535-1a828eead82e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0808845 May 25 15:47:14.936385 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a828eb92-7b6c-43f9-8b2f-c02ee021ec46 req-47be9b26-f6c9-4ab1-ba45-861be8ba4181 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388520 May 25 15:47:16.075589 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e req-12691c38-b831-4ff1-98d1-e62041624cda tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:16.077281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e req-12691c38-b831-4ff1-98d1-e62041624cda tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0945525 May 25 15:47:16.126087 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3de9fefa-0f49-49a4-a791-a3dcd6240a6e req-86f58064-986a-41a8-9a56-820dc7bf05bd tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426280 May 25 15:47:16.295932 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 req-13087c05-fa32-4f42-b3ca-9a749026e117 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:16.297407 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 req-13087c05-fa32-4f42-b3ca-9a749026e117 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0943153 May 25 15:47:16.344943 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7d69d15e-651b-47ca-8d4e-deec140cdaf0 req-8f44917c-a252-457f-ab02-ea4da7a37ec9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395639 May 25 15:47:17.318508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 req-14b9362f-ed72-46de-83da-381338b9e061 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:17.319982 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 req-14b9362f-ed72-46de-83da-381338b9e061 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0830503 May 25 15:47:17.364628 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-19ad3e49-3bc1-48e2-b78d-3b493505b9a8 req-8e543477-659b-40f5-a15a-497fb1dbbdb8 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388644 May 25 15:47:17.535743 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c44515cd-a1a7-4537-8c75-a15efd6d6766 req-731c1dc9-f923-464d-9a43-1e700100221c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:17.537213 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c44515cd-a1a7-4537-8c75-a15efd6d6766 req-731c1dc9-f923-464d-9a43-1e700100221c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0785398 May 25 15:47:17.580993 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c44515cd-a1a7-4537-8c75-a15efd6d6766 req-3370e991-cac1-4dd6-8522-e72a41f35080 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381088 May 25 15:47:17.828794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:47:17.968065 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:17.980907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:47:18.034436 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:18.051232 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:47:18.067314 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:18.071092 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:18.072869 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:18.109932 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 req-78f555ef-340c-4934-955e-8779cf8ba398 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:18.111401 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 req-78f555ef-340c-4934-955e-8779cf8ba398 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.0837598 May 25 15:47:18.141712 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=6']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:18.149189 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.149548 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.149889 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.150747 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.151081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.151410 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.151806 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.152679 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.152679 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.152890 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.153096 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.153416 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:18.159279 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:18.159571 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a52ab9ab-f72b-41fb-96ea-187adce9b2c6 req-128a82a3-ee33-410e-9265-ed67b9c15dfe tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424180 May 25 15:47:18.245875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['8c3b5d16-b63c-438e-a031-8606d9e7796f'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:47:18.553044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06917c24-469c-469a-ab01-d5281bdca5c5 req-60e279bb-0b01-48a5-bf4a-3c0ad1fef448 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:18.554420 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-06917c24-469c-469a-ab01-d5281bdca5c5 req-60e279bb-0b01-48a5-bf4a-3c0ad1fef448 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0802245 May 25 15:47:18.598557 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-06917c24-469c-469a-ab01-d5281bdca5c5 req-5afaae5e-3293-4029-9284-52e0d93adc82 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376492 May 25 15:47:18.767895 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576dab51-e62f-4845-b326-32abe8524f77 req-a25a5e8d-daea-4d3a-8650-da123a7f9191 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:18.770009 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-576dab51-e62f-4845-b326-32abe8524f77 req-a25a5e8d-daea-4d3a-8650-da123a7f9191 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 944 time: 0.0796270 May 25 15:47:18.814145 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-576dab51-e62f-4845-b326-32abe8524f77 req-560914c3-af99-4f2a-ab30-8d9de3927a98 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386124 May 25 15:47:19.441208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aed3023-1a9b-4fd4-b553-3748077ab40a req-a9d7e5ee-d1e7-41b5-a961-e8011b003f9b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:19.442605 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4aed3023-1a9b-4fd4-b553-3748077ab40a req-a9d7e5ee-d1e7-41b5-a961-e8011b003f9b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.1747742 May 25 15:47:19.487654 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4aed3023-1a9b-4fd4-b553-3748077ab40a req-74cb4da0-4f11-46ae-befc-8c2e020722cf tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385799 May 25 15:47:19.790066 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b15de1bc-ed16-4cec-aeb2-9d167c69508e req-d0af877c-4570-442e-b686-2f949d6eb1f1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:19.792300 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b15de1bc-ed16-4cec-aeb2-9d167c69508e req-d0af877c-4570-442e-b686-2f949d6eb1f1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 944 time: 0.0839303 May 25 15:47:19.827253 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 241b07d8-fed4-43ac-a7e1-530b98daf731 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:47:19.836244 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:47:19.842040 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b15de1bc-ed16-4cec-aeb2-9d167c69508e req-542a6238-95e4-4224-9841-3afa1326684a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441887 May 25 15:47:20.010598 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 8c3b5d16-b63c-438e-a031-8606d9e7796f triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:47:20.010981 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:20.039034 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da48e864-9a0e-4175-b3c3-f7b96f0215cd req-f8151e13-c73d-420f-b3e3-fb28852d15fd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:20.042458 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-da48e864-9a0e-4175-b3c3-f7b96f0215cd req-f8151e13-c73d-420f-b3e3-fb28852d15fd tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 944 time: 0.0951381 May 25 15:47:20.077784 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=241b07d8-fed4-43ac-a7e1-530b98daf731,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:20.090225 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-da48e864-9a0e-4175-b3c3-f7b96f0215cd req-01367871-5479-4bf7-bce1-4b51db6b2128 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418012 May 25 15:47:20.095948 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:47:20.226329 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:20.256250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 241b07d8-fed4-43ac-a7e1-530b98daf731 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:47:20.260403 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:20.303803 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:20.315162 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=241b07d8-fed4-43ac-a7e1-530b98daf731,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:20.322898 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:20.329276 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:20.331221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:20.333259 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-58bf8bc7-d753-4238-81c6-d452a44d1646 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.402308 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'code': 200} May 25 15:47:20.418101 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=7']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:20.498575 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:20.501884 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.502470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.103s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:20.502821 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:20.740767 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['241b07d8-fed4-43ac-a7e1-530b98daf731'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:47:20.880428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158c903b-c9e1-485e-b10d-95ff78489344 req-0ce207d9-08f1-4dda-b904-065787ede294 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:20.882629 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-158c903b-c9e1-485e-b10d-95ff78489344 req-0ce207d9-08f1-4dda-b904-065787ede294 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.3057582 May 25 15:47:21.048032 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52ba210-2c35-4abb-a63f-21ae85e61c32 req-e42a12d8-fd92-41b0-ae52-b35e804d9e00 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:21.058602 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f52ba210-2c35-4abb-a63f-21ae85e61c32 req-e42a12d8-fd92-41b0-ae52-b35e804d9e00 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 945 time: 0.4420216 May 25 15:47:21.124522 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f52ba210-2c35-4abb-a63f-21ae85e61c32 req-9d378aab-8f67-49fb-8efd-d9924f9a62c0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0626254 May 25 15:47:21.163774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Deleting port 95018903-b76e-4499-90aa-6e8e90060c3c {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:47:21.164307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:21.212414 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 req-345eabac-0b06-4239-b48a-99c271d62808 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:21.214640 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 req-345eabac-0b06-4239-b48a-99c271d62808 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 945 time: 0.1813977 May 25 15:47:21.316477 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-79ee3ee4-f951-4f59-8e5c-5f2fd505c371 req-5e328e5c-e10b-480a-9362-559b80bca53b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0940442 May 25 15:47:21.344927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] For port 95018903-b76e-4499-90aa-6e8e90060c3c, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=95018903-b76e-4499-90aa-6e8e90060c3c,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:21.345670 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:21.519247 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling delete_port for 95018903-b76e-4499-90aa-6e8e90060c3c owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:47:21.580871 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cbdb2ff-0052-4871-886e-de78b39afed4 req-0f6b2e5b-aad4-4d44-b5d8-926b19f85a11 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:21.582187 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1cbdb2ff-0052-4871-886e-de78b39afed4 req-0f6b2e5b-aad4-4d44-b5d8-926b19f85a11 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.2242000 May 25 15:47:21.673537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1cbdb2ff-0052-4871-886e-de78b39afed4 req-3e863e3c-7766-4d32-a98e-e766b350462e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0789204 May 25 15:47:21.709772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:21.717327 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:21.763834 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Pushing event deleted for resources: {'Port': ['ID=95018903-b76e-4499-90aa-6e8e90060c3c,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:21.766829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:21.845927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] No DVR routers for this DVR port 95018903-b76e-4499-90aa-6e8e90060c3c on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:47:21.848422 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:21.852290 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'name': 'network-vif-deleted', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:21.868796 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-158c903b-c9e1-485e-b10d-95ff78489344 req-ea243392-396c-45c4-978e-05fd6bc80d07 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "DELETE /v2.0/ports/95018903-b76e-4499-90aa-6e8e90060c3c HTTP/1.1" status: 204 len: 173 time: 0.9783151 May 25 15:47:21.913852 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7712bac3-f186-45b0-bf23-cd5e6c4b4664', 'name': 'network-vif-deleted', 'tag': '95018903-b76e-4499-90aa-6e8e90060c3c', 'status': 'completed', 'code': 200} May 25 15:47:22.293578 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-87d97001-6779-47c0-b28f-9f141e6cb683 req-d897f4ff-244c-4f67-a39a-6e00b6409c15 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=7712bac3-f186-45b0-bf23-cd5e6c4b4664 HTTP/1.1" status: 200 len: 210 time: 0.0471725 May 25 15:47:22.535289 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 req-732452bb-fc83-4b42-8aba-e4a01b37b0c9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:22.542979 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 req-732452bb-fc83-4b42-8aba-e4a01b37b0c9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 945 time: 0.1211102 May 25 15:47:22.587912 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5c387e98-1a47-45dc-b15f-d3fe1252fd86 req-9583afd8-3441-424f-9d66-b23bdaebd145 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440056 May 25 15:47:22.900292 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c req-92811627-af6b-49b6-9b3d-f7cf55248790 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:22.901949 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c req-92811627-af6b-49b6-9b3d-f7cf55248790 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0896800 May 25 15:47:22.964187 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2a89e070-98cd-471d-8e8b-c5f3e9fc423c req-6e07aac1-79d0-443b-8022-58dfd05c1c20 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561225 May 25 15:47:23.837513 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 241b07d8-fed4-43ac-a7e1-530b98daf731 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:47:23.874148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5978205-da2d-46ca-ab72-184a8eacc018 req-7200b324-1916-492f-97bb-4c2df0d7eb28 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:23.875933 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5978205-da2d-46ca-ab72-184a8eacc018 req-7200b324-1916-492f-97bb-4c2df0d7eb28 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 945 time: 0.0959234 May 25 15:47:23.922231 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 241b07d8-fed4-43ac-a7e1-530b98daf731 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:47:23.930118 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 241b07d8-fed4-43ac-a7e1-530b98daf731 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:47:23.930616 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:23.939796 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5978205-da2d-46ca-ab72-184a8eacc018 req-cbb6db5c-2ed7-44fa-acd6-afb685025528 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0570736 May 25 15:47:24.070406 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:24.104605 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:24.116246 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=241b07d8-fed4-43ac-a7e1-530b98daf731,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:24.121576 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:24.122796 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 95018903-b76e-4499-90aa-6e8e90060c3c no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:47:24.169179 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1aa8fa83-81c8-46da-8533-649760845071 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:24.196628 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f0870-e6dd-4e25-bfd3-273919479b8f req-92b5dad4-9f89-4e13-8878-886a27cb54c4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:24.199405 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-687f0870-e6dd-4e25-bfd3-273919479b8f req-92b5dad4-9f89-4e13-8878-886a27cb54c4 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.1018615 May 25 15:47:24.214081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 95018903-b76e-4499-90aa-6e8e90060c3c {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:47:24.214081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 95018903-b76e-4499-90aa-6e8e90060c3c not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:47:24.215046 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'code': 200} May 25 15:47:24.249310 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-687f0870-e6dd-4e25-bfd3-273919479b8f req-61bfd49c-a1c7-4479-8528-7874139209e0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435269 May 25 15:47:24.278449 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:24.278449 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:25.146488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4243e4-d456-4fc8-b845-8e2646f80c46 req-9ca31f00-8f4b-49f0-9c2e-7deec6fd05d7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:25.148318 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6f4243e4-d456-4fc8-b845-8e2646f80c46 req-9ca31f00-8f4b-49f0-9c2e-7deec6fd05d7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.0934627 May 25 15:47:25.206359 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6f4243e4-d456-4fc8-b845-8e2646f80c46 req-71ba4cbd-d9a1-4fd0-b3f2-0da973327479 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514245 May 25 15:47:25.457904 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 req-2ddf36c5-8f24-4c43-894a-56c650640302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:25.459787 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 req-2ddf36c5-8f24-4c43-894a-56c650640302 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0887585 May 25 15:47:25.507118 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6bf64d13-1532-47ed-b67a-5dfcf30502a7 req-6a3167e1-33d7-43a0-8cfe-99a1da63bff8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409479 May 25 15:47:26.391551 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d req-87fefe88-cd95-4226-893c-5b1beccedc1d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:26.393350 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d req-87fefe88-cd95-4226-893c-5b1beccedc1d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.0829136 May 25 15:47:26.446176 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-df62b1c1-5451-4f7d-8ca0-f01f6ae2378d req-e39bc44e-d6f8-477d-b891-24fc7f0b0233 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469613 May 25 15:47:26.711159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d15d130-62a0-4673-bc17-986af24f6d4c req-2258b3f2-4e80-4f2c-8928-25cb382423bc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:26.713231 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4d15d130-62a0-4673-bc17-986af24f6d4c req-2258b3f2-4e80-4f2c-8928-25cb382423bc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0886409 May 25 15:47:26.768784 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4d15d130-62a0-4673-bc17-986af24f6d4c req-0022072b-382d-4f4c-9ab0-69e0adbcf724 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490351 May 25 15:47:27.681996 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 req-ea35212c-76a1-44bd-a374-cff8071d589e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:27.683477 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 req-ea35212c-76a1-44bd-a374-cff8071d589e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.1237926 May 25 15:47:27.732794 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-46abca36-84b4-410e-9b7f-c9fcbc5f0fc9 req-abc8f22a-23a1-4b0a-811e-18da31d65093 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419943 May 25 15:47:28.070096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e966ed25-0bcb-42b5-a5cd-2740847b64ba req-1628f26c-f80f-456a-985a-a82f2c3f9ddd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:28.072283 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e966ed25-0bcb-42b5-a5cd-2740847b64ba req-1628f26c-f80f-456a-985a-a82f2c3f9ddd service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1099 time: 0.1548424 May 25 15:47:28.084051 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb req-d1ee118d-153a-4537-a168-4ad49027b113 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:28.085823 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb req-d1ee118d-153a-4537-a168-4ad49027b113 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.1293507 May 25 15:47:28.152824 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e966ed25-0bcb-42b5-a5cd-2740847b64ba req-38ccae19-44d8-47a5-a0e5-4517d9b0f844 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0658662 May 25 15:47:28.160356 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2e7bd59f-c1bd-4502-a8ae-b11bf4bc28fb req-929b911e-97f4-4759-89cb-3fd2c4e281e9 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0604308 May 25 15:47:29.099381 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfcda73-c901-43a7-b146-62c9123f5cfe req-c17aa8b7-9b52-4c70-8b9d-2f89d4682e34 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:29.100360 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6dfcda73-c901-43a7-b146-62c9123f5cfe req-c17aa8b7-9b52-4c70-8b9d-2f89d4682e34 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.1089778 May 25 15:47:29.160517 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6dfcda73-c901-43a7-b146-62c9123f5cfe req-cc2e6cb7-626b-4e7e-92d2-5673d8de07a5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457611 May 25 15:47:29.363162 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f43c439-afd5-4622-8695-b453dc696639 req-3a702b30-f9ee-487c-9935-489fe7ac0823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:29.364655 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5f43c439-afd5-4622-8695-b453dc696639 req-3a702b30-f9ee-487c-9935-489fe7ac0823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0810401 May 25 15:47:29.410079 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5f43c439-afd5-4622-8695-b453dc696639 req-f47caf19-4967-4915-805c-c6ba10fb1eca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394251 May 25 15:47:29.674156 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:47:29.967118 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-381af982-ea4e-420f-86ca-f542fabf72a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:30.131627 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-25e6d320-aa81-4e83-9e91-a8b2228e9135 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.133145 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-25e6d320-aa81-4e83-9e91-a8b2228e9135 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1098 time: 0.0709951 May 25 15:47:30.270600 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-df04f0a6-1223-4cef-9ea6-9942f2f5c1c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.272252 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-df04f0a6-1223-4cef-9ea6-9942f2f5c1c4 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1318352 May 25 15:47:30.551051 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-d6be96a3-b3a8-47ac-9c4a-e54458a38e49 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 1001 time: 0.2292042 May 25 15:47:30.621838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4ee050-b78e-4aba-a957-06910d587a19 req-852dee4c-8f44-4a1e-b03c-061372d73ed9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.623370 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9c4ee050-b78e-4aba-a957-06910d587a19 req-852dee4c-8f44-4a1e-b03c-061372d73ed9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.3394430 May 25 15:47:30.640912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03636782-b5f1-4319-a766-a778ca98d235 req-f1db07a4-9e8b-4796-9635-6f4c4aad9e38 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.642510 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-03636782-b5f1-4319-a766-a778ca98d235 req-f1db07a4-9e8b-4796-9635-6f4c4aad9e38 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.1006916 May 25 15:47:30.672080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-7b0056bb-d8f6-4095-a3bf-e804574f24d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.673565 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-7b0056bb-d8f6-4095-a3bf-e804574f24d5 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.1118896 May 25 15:47:30.680401 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9c4ee050-b78e-4aba-a957-06910d587a19 req-fcd09599-cd67-414e-9228-4048e55be5ae tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0505943 May 25 15:47:30.688761 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-03636782-b5f1-4319-a766-a778ca98d235 req-59d57d01-42d6-430d-a7cd-52ec3bc5291e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401685 May 25 15:47:30.760363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-ef548d2c-637e-471d-b7c0-68fdb40b1f3b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.761837 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-ef548d2c-637e-471d-b7c0-68fdb40b1f3b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0772350 May 25 15:47:30.957316 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-41fa2446-8c4b-4731-bf5f-021604caeab2 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1840608 May 25 15:47:30.964968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe9b578-0264-45b5-9de7-c95039d95a9b req-1002a8fa-d46a-42bf-8f87-355c6ca4008f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:30.966309 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0fe9b578-0264-45b5-9de7-c95039d95a9b req-1002a8fa-d46a-42bf-8f87-355c6ca4008f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.1755290 May 25 15:47:31.086489 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0fe9b578-0264-45b5-9de7-c95039d95a9b req-e5830990-4037-4dbc-a6c0-5956534480c9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1025057 May 25 15:47:31.108860 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48344) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:47:31.123095 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-18d3b8bd-06b2-402a-bd14-33d0bee2c5cb req-e4d3454f-07f8-4d79-bb99-4b31f6c04bbe service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1558800 May 25 15:47:31.177675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-160bf7ad-0e3b-47da-9278-1fe1d297117d tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:31.179156 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-160bf7ad-0e3b-47da-9278-1fe1d297117d tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1094 time: 0.0693159 May 25 15:47:31.182337 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48348) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:47:31.187375 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address': '172.20.0.13'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:47:31.192972 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:47:31.196737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:floatingip and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:47:31.200144 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:47:31.206065 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:47:31.216397 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.352673 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.490997 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_common [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.27.0.89 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/79495442-8f3c-4bab-8e8a-579aac2d2b66) {{(pid=98463) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:47:31.637809 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.672215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:31.683515 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5d3b2610-17d4-49ce-bf81-16ec63fca9ed service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:31.748267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98463) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:47:31.751213 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:47:31.754971 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98463) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:47:31.888876 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 req-fd3759a1-3b3e-4542-9401-8268dba3a766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:31.889695 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=79495442-8f3c-4bab-8e8a-579aac2d2b66,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:31.890524 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 req-fd3759a1-3b3e-4542-9401-8268dba3a766 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 945 time: 0.0862665 May 25 15:47:31.906155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.906541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.906915 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.907296 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.907645 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.908044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.908410 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.908769 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.909123 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.909478 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.909829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.910178 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:47:31.915254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:31.935295 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8eb9a64a-cfeb-404c-86fb-ed8dda5064f6 req-d71afe02-0757-44e6-9a26-750cbfa2a4bc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391278 May 25 15:47:32.276322 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.354008 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.475360 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:47:32.566313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.570559 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1839637'] for port, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.575673 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-61125be4-293e-4601-96d1-7b7a9a336450 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:32.589428 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.617354 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:32.637470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:32.642736 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.644731 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-b10e2ca1-257e-4373-b5e9-01369a7619cc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:32.679324 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'code': 200} May 25 15:47:32.692641 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=79495442-8f3c-4bab-8e8a-579aac2d2b66,revision_number=2']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:32.695628 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.702160 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.718252 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9c24c4ad-d2c5-4761-91eb-6abf25e41372 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:32.728112 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=8']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:32.732569 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:32.754436 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.179s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:32.873106 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP 87abb731-2ba6-407d-b27b-3addb54ec28c associated. External IP: 172.27.0.89, port: 241b07d8-fed4-43ac-a7e1-530b98daf731. May 25 15:47:33.125809 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1613ba62-df06-4ae7-a890-fe435d0ffc35 req-fe8c4724-9169-485c-8fb8-dfaf523960f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:33.127198 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1613ba62-df06-4ae7-a890-fe435d0ffc35 req-fe8c4724-9169-485c-8fb8-dfaf523960f5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0795712 May 25 15:47:33.175426 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1613ba62-df06-4ae7-a890-fe435d0ffc35 req-3378517b-2016-49f5-b5d6-b74a049f880f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425284 May 25 15:47:33.222668 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:47:33.458928 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:33.507710 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:47:33.517602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:47:33.526986 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:47:33.527621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:47:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:47:33.532033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:33.590412 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4069331 May 25 15:47:33.591154 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:33.640773 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'status': 'completed', 'code': 200} May 25 15:47:33.711233 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:47:34.052424 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:32Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:47:34.056094 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:47:34.064666 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:47:34.065265 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:47:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:47:34.272322 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:47:34.365418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5bef527-74c0-47eb-bc31-f849a22fef5d req-7529123a-af85-4b0b-9b39-69b210535dec tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:34.366811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c5bef527-74c0-47eb-bc31-f849a22fef5d req-7529123a-af85-4b0b-9b39-69b210535dec tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0782409 May 25 15:47:34.411382 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c5bef527-74c0-47eb-bc31-f849a22fef5d req-62c0c83a-415f-45bf-8186-0de8028e9291 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383327 May 25 15:47:34.614081 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:32Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:47:34.617951 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d259927-c8b3-466d-bcc5-5de9b6280dc8 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:32Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:47:34.770113 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-377db010-0fee-49b2-85f0-f8818726f7d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:34.772288 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-377db010-0fee-49b2-85f0-f8818726f7d5 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1099 time: 0.0770681 May 25 15:47:34.841915 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9589a8ee-2ea1-43cd-9185-efc8fbc5a1e1 None None] New status for floating IP 87abb731-2ba6-407d-b27b-3addb54ec28c: ACTIVE {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:47:34.939502 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-bc4f16b6-5e4b-451e-adbc-cfb85c486d8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:34.941026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-bc4f16b6-5e4b-451e-adbc-cfb85c486d8b service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1572888 May 25 15:47:35.057393 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-0f038c75-e640-4d87-88a5-5d84ae7d8c84 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 999 time: 0.1038232 May 25 15:47:35.129390 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-ad9c4e18-8d62-43a2-97c5-efe2035828c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:35.131069 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-ad9c4e18-8d62-43a2-97c5-efe2035828c2 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0645545 May 25 15:47:35.176126 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:35.216797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-da83c1e4-de92-4719-a76a-8b1c3b1f94d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:35.218297 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-da83c1e4-de92-4719-a76a-8b1c3b1f94d4 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0773964 May 25 15:47:35.354481 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-8149746f-d2d7-48ed-995a-781b586dc9e2 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231401 May 25 15:47:35.630943 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-34d1f05a-bf1f-4815-8baa-fd94570d0f04 req-0375f07a-6ae6-445f-831c-910f847b32b5 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2668929 May 25 15:47:35.649907 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 req-b04c0a4b-2ef4-433b-b5bb-52f4c8d3b034 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:35.651877 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 req-b04c0a4b-2ef4-433b-b5bb-52f4c8d3b034 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.1263590 May 25 15:47:35.699250 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3a389ba1-4be8-4185-a9c2-88bff3c94e29 req-4578e1d9-a7a8-4e2d-91f3-78d034fa0a1d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398614 May 25 15:47:36.113394 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-adaaa261-8bbc-455e-925c-b485aa0255c7 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:36.114826 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-adaaa261-8bbc-455e-925c-b485aa0255c7 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 813 time: 0.1455865 May 25 15:47:36.129008 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-20eee999-5ebe-4cd3-b597-53a133e41bcb tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/quotas/fd3e84780cc8404caa2bc8b9b90bcfab HTTP/1.1" status: 200 len: 375 time: 0.0088127 May 25 15:47:36.176901 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-fd7080d0-a236-41e2-94bd-c13863acf23f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0430944 May 25 15:47:36.351918 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-fc66c98f-948b-4c32-bdf3-b8ba796d3456 service neutron] 10.222.0.36 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1680431 May 25 15:47:36.481863 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-aef28b8e-8cba-460e-93e0-386156c877ae service neutron] 10.222.0.36 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239972 May 25 15:47:36.657277 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-db829203-11e2-4eda-94d6-578a6dde56dd req-b5565405-6252-4d9c-99b3-3ab861b07a33 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:47:36.675796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-db829203-11e2-4eda-94d6-578a6dde56dd req-b5565405-6252-4d9c-99b3-3ab861b07a33 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:47:36.677064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-db829203-11e2-4eda-94d6-578a6dde56dd req-b5565405-6252-4d9c-99b3-3ab861b07a33 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 210 time: 0.0643411 May 25 15:47:36.899890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41b47292-3611-4472-b515-1c95c046356b req-1f232272-e0c0-4c4e-b9ee-c8472e3cab04 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:36.904405 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-41b47292-3611-4472-b515-1c95c046356b req-1f232272-e0c0-4c4e-b9ee-c8472e3cab04 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0854726 May 25 15:47:36.952087 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-41b47292-3611-4472-b515-1c95c046356b req-6cab882f-3d6c-4c23-a320-52e6bee86a0a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446186 May 25 15:47:37.828771 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dcbcbb24-4d96-43cf-810b-9e68dfcf848d req-9973b2a8-7624-4ed8-a6e1-821bfe85e7c9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 210 time: 0.0460761 May 25 15:47:38.148090 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d14e351-44b4-485e-bfe2-936c80379903 req-25c43da7-450f-41d1-a844-c74c61716670 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:38.149707 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0d14e351-44b4-485e-bfe2-936c80379903 req-25c43da7-450f-41d1-a844-c74c61716670 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0846889 May 25 15:47:38.198816 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0d14e351-44b4-485e-bfe2-936c80379903 req-10f60114-1512-4b99-aa29-6ced3230d3b8 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418258 May 25 15:47:38.245726 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-a13fffd6-57da-4a4e-b190-9f355fd38db4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:38.247566 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-a13fffd6-57da-4a4e-b190-9f355fd38db4 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 813 time: 0.1638780 May 25 15:47:38.270413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Request body: {'port': {'device_id': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236', 'admin_state_up': True, 'tenant_id': 'fd3e84780cc8404caa2bc8b9b90bcfab'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:47:38.419492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:47:38.435379 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:47:38.445419 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Made reservation on behalf of fd3e84780cc8404caa2bc8b9b90bcfab for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:47:38.448948 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:38.617193 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Allocated IP 172.20.0.13 (3c515845-6e63-4d8b-b829-eb7af03f0236/cc10550a-268b-4838-b7df-f6dc84fd8286/3def0d10-a624-4491-98d7-d5e621924663) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:47:38.824391 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:38.854624 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:38.860492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d606358-ea98-4747-8a15-7137382ce8a0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:38.923328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Network 3c515845-6e63-4d8b-b829-eb7af03f0236 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:47:38.926551 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:47:38.930650 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:47:39.021145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Pushing event updated for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:39.033074 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:39.055961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:39.057132 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:39.090354 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8248236 May 25 15:47:39.098672 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 req-39c09345-f163-43f3-a63d-0a9d1da63f4a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:39.099358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 req-39c09345-f163-43f3-a63d-0a9d1da63f4a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:47:39.107492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Request body: {'port': {'device_id': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:47:39.167056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 req-39c09345-f163-43f3-a63d-0a9d1da63f4a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:47:39.168207 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 req-39c09345-f163-43f3-a63d-0a9d1da63f4a tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 932 time: 0.2054694 May 25 15:47:39.256077 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:39.274863 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0fc04f9f-20e6-4b5e-adc1-431b5f511349 req-23992aa0-859c-4892-bda8-5b47485b7de7 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731905 May 25 15:47:39.762265 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3def0d10-a624-4491-98d7-d5e621924663 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:47:39.771454 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:39.792736 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Transition to ACTIVE for port object 3def0d10-a624-4491-98d7-d5e621924663 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:47:39.797789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:39.803461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:39.922153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd req-ed8c91e2-6f42-4f56-b759-18935eb1910e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:39.923635 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd req-ed8c91e2-6f42-4f56-b759-18935eb1910e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.3169148 May 25 15:47:39.929677 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48474) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:47:39.959303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:47:40.003230 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Pushing event updated for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:40.013038 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.064313 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a26f614a-45c6-4d1c-9c3e-d11a85dafedd req-300f5b44-0f67-4d39-a9e7-4a99d3895c86 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1301041 May 25 15:47:40.093013 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Attempting to bind port 3def0d10-a624-4491-98d7-d5e621924663 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:47:40.093602 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Attempting to bind port 3def0d10-a624-4491-98d7-d5e621924663 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:47:40.094010 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Attempting to bind port 3def0d10-a624-4491-98d7-d5e621924663 on network 3c515845-6e63-4d8b-b829-eb7af03f0236 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:47:40.096320 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-d7982048-b601-40fa-af01-c6f51592f807 service neutron] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1647208 May 25 15:47:40.098843 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Port 3def0d10-a624-4491-98d7-d5e621924663 on network 3c515845-6e63-4d8b-b829-eb7af03f0236 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:47:40.099170 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Attempting to bind port 3def0d10-a624-4491-98d7-d5e621924663 on network 3c515845-6e63-4d8b-b829-eb7af03f0236 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:47:40.104576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 47, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:47:40.104915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Checking segment: {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:47:40.105299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Bound using segment: {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:47:40.105729 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Bound port: 3def0d10-a624-4491-98d7-d5e621924663, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '915eeaf5-0ce1-4cff-820c-f43904e568be', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:47:40.106079 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:40.209677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:47:40.213463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3def0d10-a624-4491-98d7-d5e621924663,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:47:40.218731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:40.223772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6b29fac6-f924-4005-993d-3656f6f58b95 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:40.281571 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:40.282166 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:40.283523 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] 10.222.0.70 "PUT /v2.0/ports/3def0d10-a624-4491-98d7-d5e621924663 HTTP/1.1" status: 200 len: 1094 time: 1.1805813 May 25 15:47:40.284043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'tag': '3def0d10-a624-4491-98d7-d5e621924663'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:40.306541 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Pushing event updated for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:40.309679 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:40.333746 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'tag': '3def0d10-a624-4491-98d7-d5e621924663', 'status': 'completed', 'code': 200} May 25 15:47:40.487663 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-96fe8d96-1fb9-41bb-a573-51fa0ecb9277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:40.489192 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-96fe8d96-1fb9-41bb-a573-51fa0ecb9277 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 1097 time: 0.1416636 May 25 15:47:40.498144 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6284e51e-862a-4420-b3e0-91e0bb72d806 req-56280ed8-b9ca-42db-9620-18934de357d3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:40.499577 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6284e51e-862a-4420-b3e0-91e0bb72d806 req-56280ed8-b9ca-42db-9620-18934de357d3 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 944 time: 0.1012640 May 25 15:47:40.580701 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-317db9d9-7adf-4e56-8365-8ffa882b0a94 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3def0d10-a624-4491-98d7-d5e621924663 HTTP/1.1" status: 200 len: 217 time: 0.0774159 May 25 15:47:40.643555 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6284e51e-862a-4420-b3e0-91e0bb72d806 req-b07bced5-ae24-46c1-8a79-8843702d9a9d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834610 May 25 15:47:40.663508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-d4a634f4-05e3-41af-b282-398559518ca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:40.664981 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-d4a634f4-05e3-41af-b282-398559518ca9 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cc10550a-268b-4838-b7df-f6dc84fd8286 HTTP/1.1" status: 200 len: 853 time: 0.0673940 May 25 15:47:40.724441 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-93b07745-b4ac-42a4-b831-b24d59c9bbe9 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=3c515845-6e63-4d8b-b829-eb7af03f0236&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0486035 May 25 15:47:40.865753 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-5ac111aa-d063-4fe2-98dc-b23d230070b8 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1259627 May 25 15:47:40.995947 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-65e2bf0a-5b67-4a45-b618-28c93bbeebb3 req-3ffaaa1c-5d98-4ec8-a85b-9a5f9c096428 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222513 May 25 15:47:41.122731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30e7368-54f2-455e-a255-3525e87b441e req-59243b0a-842c-4237-8e8a-7513370ede34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.124227 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-59243b0a-842c-4237-8e8a-7513370ede34 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 1097 time: 0.0710881 May 25 15:47:41.263820 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6380f23-a3d5-460b-a039-67b7cd285712 req-7cb68c68-1d6d-443c-98f8-076310346b16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.265551 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b6380f23-a3d5-460b-a039-67b7cd285712 req-7cb68c68-1d6d-443c-98f8-076310346b16 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0844166 May 25 15:47:41.310008 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b6380f23-a3d5-460b-a039-67b7cd285712 req-6f534918-4eec-4b8d-b7f4-291304e196a2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386188 May 25 15:47:41.310908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30e7368-54f2-455e-a255-3525e87b441e req-2c0e8c4a-9fbf-4130-a362-b116c333bc2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.312393 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-2c0e8c4a-9fbf-4130-a362-b116c333bc2c service neutron] 10.222.0.70 "GET /v2.0/networks?id=3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 200 len: 914 time: 0.1777694 May 25 15:47:41.325437 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-8604371c-15aa-42c7-94aa-3c5efd5faa3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.326857 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-8604371c-15aa-42c7-94aa-3c5efd5faa3c service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e&tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3 HTTP/1.1" status: 200 len: 1096 time: 0.1096737 May 25 15:47:41.432485 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-3b1d58aa-9fb0-4ff1-b433-5ed353583b3c service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=3def0d10-a624-4491-98d7-d5e621924663 HTTP/1.1" status: 200 len: 217 time: 0.0963819 May 25 15:47:41.599072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30e7368-54f2-455e-a255-3525e87b441e req-3767cabb-df87-406b-a827-11483bf3fa22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.600531 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-3767cabb-df87-406b-a827-11483bf3fa22 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cc10550a-268b-4838-b7df-f6dc84fd8286 HTTP/1.1" status: 200 len: 853 time: 0.1500592 May 25 15:47:41.609217 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-81b692a8-ebbb-4343-8fbb-b325b430718f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.610659 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-81b692a8-ebbb-4343-8fbb-b325b430718f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1096 time: 0.2249770 May 25 15:47:41.673133 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-3d64486a-c628-40ee-a58f-f6a947591395 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=3c515845-6e63-4d8b-b829-eb7af03f0236&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0613558 May 25 15:47:41.951344 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-815e9efa-8643-44dc-8dca-80d0095fc41f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.952811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-815e9efa-8643-44dc-8dca-80d0095fc41f service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.3082116 May 25 15:47:41.959828 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3def0d10-a624-4491-98d7-d5e621924663 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:47:41.960399 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-4ef84192-eb38-48c3-ae6d-2255bfc7b47f service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2416654 May 25 15:47:41.976285 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f736cd2-96db-400b-a36f-eeaadecf3e76 req-90fd6842-aef2-49fa-8d3d-b760091839dc tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:41.977761 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0f736cd2-96db-400b-a36f-eeaadecf3e76 req-90fd6842-aef2-49fa-8d3d-b760091839dc tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 944 time: 0.1769583 May 25 15:47:42.104670 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3def0d10-a624-4491-98d7-d5e621924663,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:42.118140 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '3def0d10-a624-4491-98d7-d5e621924663', 'network_id': '3c515845-6e63-4d8b-b829-eb7af03f0236', 'port_id': '3def0d10-a624-4491-98d7-d5e621924663', 'mac_address': 'fa:16:3e:99:b2:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cc10550a-268b-4838-b7df-f6dc84fd8286', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:47:42.174842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:42.190973 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-666d4ac8-bffc-4118-8970-47307764e304 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 999 time: 0.2116616 May 25 15:47:42.194486 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3def0d10-a624-4491-98d7-d5e621924663 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:47:42.195536 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0f736cd2-96db-400b-a36f-eeaadecf3e76 req-eb95e543-e30f-4827-851d-2bce5dcd0dc8 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1480801 May 25 15:47:42.210779 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3def0d10-a624-4491-98d7-d5e621924663,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:42.220632 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:42.222582 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:42.281165 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e30e7368-54f2-455e-a255-3525e87b441e req-7fe0ad16-b27e-40a5-930d-4cfb56dcfcd8 service neutron] 10.222.0.70 "GET /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3008924 May 25 15:47:42.288154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-355b3db0-527e-4d4f-abe1-5b108c598e20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:42.288417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:42.289481 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-355b3db0-527e-4d4f-abe1-5b108c598e20 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0820026 May 25 15:47:42.292126 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:42.376314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-b35b0d0a-507f-48ee-9af9-ac3c631fa2de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:42.377811 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-b35b0d0a-507f-48ee-9af9-ac3c631fa2de service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0719657 May 25 15:47:42.511667 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c10d82cc-0050-4218-9b5a-a6465c8a93de req-fc3bdf16-6dc8-4e19-9153-8849d4153503 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:42.513185 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c10d82cc-0050-4218-9b5a-a6465c8a93de req-fc3bdf16-6dc8-4e19-9153-8849d4153503 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0792100 May 25 15:47:42.522710 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-fb797c94-cc04-4824-90f8-1107ca81ba63 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314461 May 25 15:47:42.556132 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['3def0d10-a624-4491-98d7-d5e621924663'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:47:42.563270 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c10d82cc-0050-4218-9b5a-a6465c8a93de req-331ea565-1e6d-4ea0-bc36-930271f7707b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442417 May 25 15:47:42.666769 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1bc3588e-bca8-4178-8466-be060a8451a9 req-e770cb72-5a31-4229-a78b-fe7e86ccbb51 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1305120 May 25 15:47:42.685622 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:43.430828 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10f7d536-6972-4438-aefe-b527d9a8e353 req-2556df34-03f4-4995-969e-795741376b46 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:43.433100 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-10f7d536-6972-4438-aefe-b527d9a8e353 req-2556df34-03f4-4995-969e-795741376b46 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 945 time: 0.0991766 May 25 15:47:43.491785 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-10f7d536-6972-4438-aefe-b527d9a8e353 req-6371c113-0d4c-491e-b799-9df14e50c5ea tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524645 May 25 15:47:43.759246 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 req-bf3d12ed-eecd-431e-8f5b-6211e8248371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:43.760812 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 req-bf3d12ed-eecd-431e-8f5b-6211e8248371 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0813313 May 25 15:47:43.812572 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cd2b994b-c8a5-4b6a-9b1a-669205cbb484 req-53067704-13a3-4525-bf85-d028edea9114 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444212 May 25 15:47:43.983439 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3def0d10-a624-4491-98d7-d5e621924663 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:47:44.054631 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 3def0d10-a624-4491-98d7-d5e621924663 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:47:44.059746 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 3def0d10-a624-4491-98d7-d5e621924663 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:47:44.060162 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:44.181622 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:44.209937 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3def0d10-a624-4491-98d7-d5e621924663'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:47:44.220373 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3def0d10-a624-4491-98d7-d5e621924663,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:47:44.224322 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:44.226114 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:47:44.256504 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3def0d10-a624-4491-98d7-d5e621924663', 'code': 200} May 25 15:47:44.299146 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:47:44.302367 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:47:44.696473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-821a7a75-0eb6-4bed-9834-18a9a19c769b req-a1760449-e617-49be-bb26-ea7f6475d5d0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:44.698605 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-821a7a75-0eb6-4bed-9834-18a9a19c769b req-a1760449-e617-49be-bb26-ea7f6475d5d0 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0857575 May 25 15:47:44.746967 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-821a7a75-0eb6-4bed-9834-18a9a19c769b req-d17e1acd-ca82-4e44-9a28-1ffc18cf6a82 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426750 May 25 15:47:45.013725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c3d4e4-5a21-421f-8352-f5538788cc24 req-951decb0-6b33-41d0-8a25-b37d68b973d0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:45.015363 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-53c3d4e4-5a21-421f-8352-f5538788cc24 req-951decb0-6b33-41d0-8a25-b37d68b973d0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0861876 May 25 15:47:45.059911 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-53c3d4e4-5a21-421f-8352-f5538788cc24 req-79ffcc4c-c73f-495b-a984-eb1d57623bb0 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387394 May 25 15:47:45.942979 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f req-57fcbcab-e5df-41b2-9cfd-58a93f963f02 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:45.944507 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f req-57fcbcab-e5df-41b2-9cfd-58a93f963f02 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0836587 May 25 15:47:45.993340 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7a1fe2db-08d4-4727-93ba-9bee4bbdb64f req-215c19ca-86f4-4983-a208-b5c52b6a0188 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431857 May 25 15:47:46.352827 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46da6c1f-1f9a-4057-a065-0381ca340ae3 req-c4318b93-81d4-4638-955e-191ab709db7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:46.354737 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-46da6c1f-1f9a-4057-a065-0381ca340ae3 req-c4318b93-81d4-4638-955e-191ab709db7e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.1786761 May 25 15:47:46.401311 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-46da6c1f-1f9a-4057-a065-0381ca340ae3 req-c51ae496-e0b5-4780-bdb6-eb5ca426c55c tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401897 May 25 15:47:47.187326 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77703f6f-757a-42c5-877d-92b86e7aa4c0 req-ff6e3b1e-11db-475c-b7ca-67fb50594eb1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:47.189139 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-77703f6f-757a-42c5-877d-92b86e7aa4c0 req-ff6e3b1e-11db-475c-b7ca-67fb50594eb1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0870888 May 25 15:47:47.251206 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-77703f6f-757a-42c5-877d-92b86e7aa4c0 req-33d7a982-9756-484d-89da-be6fc0a0920f tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0564373 May 25 15:47:47.590793 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 req-beb3a6d9-f5c1-4099-8fbd-3bf56737a97b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:47.592280 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 req-beb3a6d9-f5c1-4099-8fbd-3bf56737a97b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0788264 May 25 15:47:47.640907 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-42e95f25-e9c0-4075-9cda-ffc4c92187b4 req-e4b6c19d-acd6-41d2-aa6b-3cc1fc276015 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429888 May 25 15:47:48.445606 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0156d1bf-907c-4a21-962c-16879879d9a0 req-ff12fa87-3509-431f-9d01-b0e00e16fd82 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:48.447052 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0156d1bf-907c-4a21-962c-16879879d9a0 req-ff12fa87-3509-431f-9d01-b0e00e16fd82 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0844927 May 25 15:47:48.493329 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0156d1bf-907c-4a21-962c-16879879d9a0 req-d7f57659-78f4-4075-8d33-f09cd3427e3e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398777 May 25 15:47:48.840486 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 req-10912f45-e1e3-4473-a559-48f2fbd4c6ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:48.841977 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 req-10912f45-e1e3-4473-a559-48f2fbd4c6ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0875258 May 25 15:47:48.891454 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-64a4f1e3-8006-4a74-a7bb-f5ac4c4b4b51 req-1ddd61d4-a945-44bf-beb1-3d3837a9739f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433095 May 25 15:47:49.686381 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 req-6b6f4b97-72b1-441c-8a7e-952163b43a0e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:49.687751 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 req-6b6f4b97-72b1-441c-8a7e-952163b43a0e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0869424 May 25 15:47:49.733138 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b56f6c00-ed32-419e-9376-989e4e2e3cb3 req-06830a31-23fe-4422-bc12-30ac21b7e1d6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396664 May 25 15:47:50.092269 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623f3aaa-7a15-48cc-ba83-c852eb01e185 req-31d8d306-050c-4b11-b79e-de1a7022f4d5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:50.093782 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-623f3aaa-7a15-48cc-ba83-c852eb01e185 req-31d8d306-050c-4b11-b79e-de1a7022f4d5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0811353 May 25 15:47:50.143314 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-623f3aaa-7a15-48cc-ba83-c852eb01e185 req-29c97f8c-16d5-43bf-bc8f-bbd94b147178 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439131 May 25 15:47:50.934722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd req-2c4a8f99-40b1-432c-936c-196b1b457fd1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:50.936231 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd req-2c4a8f99-40b1-432c-936c-196b1b457fd1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0835001 May 25 15:47:50.983262 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c422da89-7ab3-469a-8ff6-76b9f58dd0dd req-8099b2d1-a016-43e5-99f4-26c51b4014ff tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410068 May 25 15:47:51.342097 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 req-6993b3e7-7303-4534-be8e-98a9a3251e18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:51.343765 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 req-6993b3e7-7303-4534-be8e-98a9a3251e18 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0877445 May 25 15:47:51.391471 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bcf27eec-d62f-458b-90c2-ad9b3e78f198 req-7703e2a0-de32-44e2-a328-1a361a3b0f6e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413594 May 25 15:47:52.172482 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02faa3ef-0cf1-4452-84b4-f2c4db663206 req-51ce8c1a-7140-488b-938f-94bca9417895 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:52.174012 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02faa3ef-0cf1-4452-84b4-f2c4db663206 req-51ce8c1a-7140-488b-938f-94bca9417895 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0829587 May 25 15:47:52.221443 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-02faa3ef-0cf1-4452-84b4-f2c4db663206 req-98e73195-b0c0-48af-8be6-5f41022baa6b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414748 May 25 15:47:52.590362 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-348eb279-1081-4174-9e06-a5b333efc86d req-6e887e32-4a63-4b7c-9277-3f89c38118c7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:52.591854 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-348eb279-1081-4174-9e06-a5b333efc86d req-6e887e32-4a63-4b7c-9277-3f89c38118c7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0866110 May 25 15:47:52.638349 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-348eb279-1081-4174-9e06-a5b333efc86d req-68fcd4b4-e795-49cd-9465-ea22f79fb42b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408430 May 25 15:47:53.440764 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 req-ad6671a8-ad2e-46af-9523-9dadc107c824 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:53.442365 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 req-ad6671a8-ad2e-46af-9523-9dadc107c824 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.1065776 May 25 15:47:53.508924 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-28f59039-02b4-49a1-95c4-b444bb2cb3b1 req-59fe73d2-b67e-4d7e-903c-a45919cb00e9 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508561 May 25 15:47:53.844238 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1516cf7-02c5-43bf-b345-b89166971239 req-740d5173-e34d-4816-9444-d13754c012d5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:53.845750 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1516cf7-02c5-43bf-b345-b89166971239 req-740d5173-e34d-4816-9444-d13754c012d5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0872922 May 25 15:47:53.897975 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1516cf7-02c5-43bf-b345-b89166971239 req-1e568976-d463-4751-8a26-fe015d2a4166 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417638 May 25 15:47:54.661434 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a req-17a502da-e800-4c25-883d-f8bb2a6695d9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:54.662821 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a req-17a502da-e800-4c25-883d-f8bb2a6695d9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0910378 May 25 15:47:54.714046 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dc6bd3a8-b70a-4a2e-9c8a-8422ea4d050a req-70c5439d-b9f4-4afd-8515-6bb59ce51fcd tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447073 May 25 15:47:54.897941 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 req-58a2cd6c-85f2-4eec-b430-c5d8ffc2db88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:54.899428 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 req-58a2cd6c-85f2-4eec-b430-c5d8ffc2db88 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0897677 May 25 15:47:54.945987 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-38d0e36e-4fa1-44e3-889e-f23abaea7a28 req-82d719f8-d421-4a92-b3fc-3765d4c9e9fe tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401149 May 25 15:47:55.130138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb req-bc140baa-e862-4057-b1b2-7dd13ea2af46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:55.131607 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb req-bc140baa-e862-4057-b1b2-7dd13ea2af46 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0887067 May 25 15:47:55.178931 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f1a611d2-57fe-4d2c-b065-f22f30ebeafb req-347bf917-d306-4baf-9346-08ccc1f423e5 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411315 May 25 15:47:55.911843 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d1819b-4328-4707-b6f7-93f0338b58d7 req-8ad93d69-6947-440d-82be-e4b18ed7e22c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:55.913333 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d3d1819b-4328-4707-b6f7-93f0338b58d7 req-8ad93d69-6947-440d-82be-e4b18ed7e22c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0841463 May 25 15:47:55.956736 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d3d1819b-4328-4707-b6f7-93f0338b58d7 req-e08b70d2-de24-4c2e-ab7f-d566f24207ec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0371687 May 25 15:47:56.135881 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 req-7f438d18-d744-4202-b847-e29b509adec2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:56.137750 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 req-7f438d18-d744-4202-b847-e29b509adec2 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0868163 May 25 15:47:56.182389 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e1ab881c-7484-4d94-9438-9c5ae5ef4a88 req-70e1b815-2143-481f-9098-f55ce867003d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387859 May 25 15:47:56.368872 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb929601-da91-418b-9725-c97d642ac60f req-2a0a30a5-7227-4a81-af1e-cc0a2d5c636d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:56.370361 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-eb929601-da91-418b-9725-c97d642ac60f req-2a0a30a5-7227-4a81-af1e-cc0a2d5c636d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0817719 May 25 15:47:56.492228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-eb929601-da91-418b-9725-c97d642ac60f req-04af4ccf-01a2-4822-9829-8e5ed66e8246 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1157951 May 25 15:47:57.146971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 req-562bd6de-9caa-495f-ac75-4ed34cbf4272 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:57.148537 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 req-562bd6de-9caa-495f-ac75-4ed34cbf4272 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0839295 May 25 15:47:57.201797 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e4feaeff-9e2c-4f06-a3cc-2b950e223b83 req-ac72631a-989d-47b1-b2e1-09dc7d192772 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463817 May 25 15:47:57.428666 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf884f4f-4f50-4964-be34-03db7c8f8331 req-e947d77e-391a-4d27-9080-5ed9a7b5ff74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:57.430157 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cf884f4f-4f50-4964-be34-03db7c8f8331 req-e947d77e-391a-4d27-9080-5ed9a7b5ff74 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 1099 time: 0.1334858 May 25 15:47:57.438490 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-598dfc56-70fd-43d0-bb27-74944c672400 req-ef5c37cf-5d8a-4694-b69e-8452dd6b8e2e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:57.439893 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-598dfc56-70fd-43d0-bb27-74944c672400 req-ef5c37cf-5d8a-4694-b69e-8452dd6b8e2e tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.1106050 May 25 15:47:57.508255 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cf884f4f-4f50-4964-be34-03db7c8f8331 req-d842ba82-e507-4d6c-9c5f-169bef339322 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672989 May 25 15:47:57.511061 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-598dfc56-70fd-43d0-bb27-74944c672400 req-41d5d643-dbe0-48f6-923e-ddd216e58110 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580318 May 25 15:47:57.690822 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef112669-395e-4c38-abfa-ac4894c3f693 req-ee7e46bb-d6c6-4cdb-8387-3b18b0b121ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:57.692214 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ef112669-395e-4c38-abfa-ac4894c3f693 req-ee7e46bb-d6c6-4cdb-8387-3b18b0b121ca tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0837080 May 25 15:47:57.736107 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ef112669-395e-4c38-abfa-ac4894c3f693 req-e4a32806-4279-4910-b33d-10c62440479d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380554 May 25 15:47:58.388102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dceca677-cfb9-400f-b3d5-fc4456410c7b req-6c855daf-c72f-4666-aad9-6ababb04289f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:58.389843 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dceca677-cfb9-400f-b3d5-fc4456410c7b req-6c855daf-c72f-4666-aad9-6ababb04289f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0817261 May 25 15:47:58.436985 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dceca677-cfb9-400f-b3d5-fc4456410c7b req-746d9ae1-5aed-4752-9213-18060b395462 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415487 May 25 15:47:58.693417 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-957c5653-43f6-4deb-ad9b-d70902aa5d05 req-cb021feb-b0b9-4340-a643-bb0a91285000 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:58.694795 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-957c5653-43f6-4deb-ad9b-d70902aa5d05 req-cb021feb-b0b9-4340-a643-bb0a91285000 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0791140 May 25 15:47:58.738921 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-957c5653-43f6-4deb-ad9b-d70902aa5d05 req-4de16966-f0e9-4f82-9497-e3692305aba1 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379181 May 25 15:47:58.938653 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae66942-044c-4943-8ba4-82f803ec078b req-1bf19d04-e228-463a-bbb7-ee8d3796873a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:58.940147 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2ae66942-044c-4943-8ba4-82f803ec078b req-1bf19d04-e228-463a-bbb7-ee8d3796873a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0915177 May 25 15:47:58.985003 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2ae66942-044c-4943-8ba4-82f803ec078b req-32e20a26-34e0-431c-9c84-c48869c54366 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391517 May 25 15:47:59.626584 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 req-db4c347c-39a2-4247-80e0-0cb1e86a0768 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:59.628758 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 req-db4c347c-39a2-4247-80e0-0cb1e86a0768 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0863609 May 25 15:47:59.673128 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-75385e81-0685-45c2-8028-a0b5fcb9a2c0 req-a2c72046-743b-47fe-9d79-f2f911350447 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387666 May 25 15:47:59.921699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70b98c18-9fab-4d66-bd0d-76634da2b323 req-d8dba844-cc5d-4dda-a19c-7fda62994e19 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:47:59.923169 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-70b98c18-9fab-4d66-bd0d-76634da2b323 req-d8dba844-cc5d-4dda-a19c-7fda62994e19 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0808129 May 25 15:47:59.969380 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6deaa39a-27e9-4bb3-84c7-e1ae0cc46f91 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:47:59.973170 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-70b98c18-9fab-4d66-bd0d-76634da2b323 req-8cb5218e-7857-46d1-a47d-b83e5b4d644c tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443258 May 25 15:48:00.119397 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:48:00.180875 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d req-ae6262c8-a326-4cea-91ab-0cf777a68676 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:00.182292 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d req-ae6262c8-a326-4cea-91ab-0cf777a68676 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 943 time: 0.0886357 May 25 15:48:00.231893 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cb158d0d-d7e2-4996-bc8b-315519a1ef7d req-488aac60-d231-4897-aaa9-548f39c34645 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435004 May 25 15:48:00.260283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:00.274034 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'port_id': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'mac_address': 'fa:16:3e:73:8d:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 389, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:48:00.330396 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:00.347749 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:48:00.363785 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:00.367738 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:00.369421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:00.476693 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=9']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:00.479806 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:00.737166 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['8c3b5d16-b63c-438e-a031-8606d9e7796f'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:48:00.860190 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 req-6f206919-4094-4705-bf40-4b0c038a4a9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:00.861671 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 req-6f206919-4094-4705-bf40-4b0c038a4a9b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0795064 May 25 15:48:00.910924 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5a8f51fe-9c1c-4cc1-ab88-91a784da5363 req-87af32fe-078e-444b-b768-8ebc83763eeb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435839 May 25 15:48:01.423380 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c45de4c5-0a4f-4f9b-8305-750f063ff75e req-ba5ab65c-2dcd-4488-a2ae-ca786069d76e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:01.424874 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c45de4c5-0a4f-4f9b-8305-750f063ff75e req-ba5ab65c-2dcd-4488-a2ae-ca786069d76e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 944 time: 0.0796502 May 25 15:48:01.473551 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c45de4c5-0a4f-4f9b-8305-750f063ff75e req-79194e93-1690-475e-8d98-a86f8f022aff tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430231 May 25 15:48:02.094082 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7691acf-a773-4744-a97e-52bd50c2d535 req-20154b54-b537-4f6f-b367-4defc57ee79c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:02.095469 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e7691acf-a773-4744-a97e-52bd50c2d535 req-20154b54-b537-4f6f-b367-4defc57ee79c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0797613 May 25 15:48:02.125668 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:48:02.140175 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e7691acf-a773-4744-a97e-52bd50c2d535 req-b9caf5d3-d837-467a-8d4e-862cab9024b8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388620 May 25 15:48:02.195605 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 8c3b5d16-b63c-438e-a031-8606d9e7796f triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:48:02.196015 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.310161 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.336878 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:02.347351 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:02.351161 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.353930 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:02.385343 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'code': 200} May 25 15:48:02.426210 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=10']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:02.429162 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:02.637345 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.695032 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-79c698e8-dbce-4c77-8b82-1d983a63ce75 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:02.740986 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-950f3c08-f85b-4530-8dd2-e9765fcc5721 req-aabedc6f-347a-4087-b141-2c1380f60f4d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:02.742459 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-950f3c08-f85b-4530-8dd2-e9765fcc5721 req-aabedc6f-347a-4087-b141-2c1380f60f4d tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.1561005 May 25 15:48:02.745153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83a52328-6776-4e91-9c60-a4a9dcac1abc req-694a1877-da19-4c46-9bff-34cfc1687575 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:02.747205 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-83a52328-6776-4e91-9c60-a4a9dcac1abc req-694a1877-da19-4c46-9bff-34cfc1687575 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1099 time: 0.1301718 May 25 15:48:02.818149 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-950f3c08-f85b-4530-8dd2-e9765fcc5721 req-0e989a8e-537f-4d38-8c63-263fdd8532ee tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692439 May 25 15:48:02.821405 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-83a52328-6776-4e91-9c60-a4a9dcac1abc req-c07332fa-0c2f-4f4e-92d0-9b9c4db57b2e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597103 May 25 15:48:03.415655 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 req-6757bccd-a380-4304-8e71-ca1e0731e389 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:03.417138 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 req-6757bccd-a380-4304-8e71-ca1e0731e389 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1724501 May 25 15:48:03.461992 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:03.462586 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-cfa2963e-de17-4e2b-ba7d-f15590e20ef3 req-0ffe21db-26fc-447f-8b1c-7c30eb937c27 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385563 May 25 15:48:04.007320 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a440896-d6f2-4ac1-9284-ffc2afd37107 req-18eac8a8-d182-4afc-b544-f916bca95603 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:04.008821 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4a440896-d6f2-4ac1-9284-ffc2afd37107 req-18eac8a8-d182-4afc-b544-f916bca95603 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.0796876 May 25 15:48:04.053281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4a440896-d6f2-4ac1-9284-ffc2afd37107 req-27795661-7552-4ceb-8bba-17be76933b8f tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389025 May 25 15:48:04.656316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a5b7d97-1565-4682-a071-5d0555ecb262 req-b1da34b5-3dc0-4f9b-9ca0-8910194704b7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:04.657816 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4a5b7d97-1565-4682-a071-5d0555ecb262 req-b1da34b5-3dc0-4f9b-9ca0-8910194704b7 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0848794 May 25 15:48:04.701347 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4a5b7d97-1565-4682-a071-5d0555ecb262 req-649aa353-91cf-447f-a165-f4ac629cec3e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0378039 May 25 15:48:05.192601 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:05.254043 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b17df0d-4fd6-490e-9048-af2fda307a24 req-c8bbb3c7-77cb-4f1d-93d8-630faa34400b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:05.255508 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b17df0d-4fd6-490e-9048-af2fda307a24 req-c8bbb3c7-77cb-4f1d-93d8-630faa34400b tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.0859342 May 25 15:48:05.300984 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3b17df0d-4fd6-490e-9048-af2fda307a24 req-cbe7ddf0-21a6-470a-b439-e49cf420ec23 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392721 May 25 15:48:05.880756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfafe1d2-0317-4eef-b529-da0f40a8189b req-8b601b00-4b7d-47cf-a072-23092e5f1e7a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:05.882282 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dfafe1d2-0317-4eef-b529-da0f40a8189b req-8b601b00-4b7d-47cf-a072-23092e5f1e7a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0783734 May 25 15:48:05.933113 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dfafe1d2-0317-4eef-b529-da0f40a8189b req-6d5ef5bf-69bd-4a5a-a707-bcf2a07f8ffe tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442560 May 25 15:48:06.674210 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:48:07.152851 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73e837db-02c3-4c56-b482-3d6629d25085 req-ee97d192-b67e-4090-b9d3-8a541b4e8097 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:07.154343 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-73e837db-02c3-4c56-b482-3d6629d25085 req-ee97d192-b67e-4090-b9d3-8a541b4e8097 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0943038 May 25 15:48:07.198852 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-73e837db-02c3-4c56-b482-3d6629d25085 req-905d3716-bd6b-4bc3-b727-9d226607a09c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388525 May 25 15:48:08.384436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6140481-6961-4dc7-bfcc-ace8a6766dcb req-06d07a40-d32b-4e23-b433-f4e1ee213fab tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:08.385802 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a6140481-6961-4dc7-bfcc-ace8a6766dcb req-06d07a40-d32b-4e23-b433-f4e1ee213fab tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0800762 May 25 15:48:08.431616 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a6140481-6961-4dc7-bfcc-ace8a6766dcb req-d3ee6b5c-8e42-4b54-a98b-b019ed82e1d9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390346 May 25 15:48:09.617543 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea req-84df9256-acb9-4dab-b9ed-95a08d573cd9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:09.618983 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea req-84df9256-acb9-4dab-b9ed-95a08d573cd9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0826313 May 25 15:48:09.661808 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-0e7511ab-b9ce-4c25-89b0-9b520ca23eea req-e6e4e717-c5a6-4fae-a6b2-58a1847f0350 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0366135 May 25 15:48:10.847779 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e344032-04e2-42e6-a975-59af1fd8b7b8 req-2afdeac5-6aba-4bc7-9730-9b364a41ac71 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:10.849278 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0e344032-04e2-42e6-a975-59af1fd8b7b8 req-2afdeac5-6aba-4bc7-9730-9b364a41ac71 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0835285 May 25 15:48:10.893063 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0e344032-04e2-42e6-a975-59af1fd8b7b8 req-741b14a3-05f6-4cd3-aa48-5b21a0f70008 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381560 May 25 15:48:12.073732 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 req-37092255-24e1-42c6-a81e-2faaec6a9b5e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:12.075120 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 req-37092255-24e1-42c6-a81e-2faaec6a9b5e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0771871 May 25 15:48:12.117963 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4522b276-558d-47ec-8bdd-3e9b3a5607b9 req-01c0849c-24de-409a-a868-b7987fb216d5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0373425 May 25 15:48:12.586451 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-8b8dabc4-83fd-47a7-a12d-ed553fd849f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:12.586451 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-8b8dabc4-83fd-47a7-a12d-ed553fd849f0 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.0769544 May 25 15:48:12.669131 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:12.728985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-e4d30037-f96e-4841-9e24-078fd58f14b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:12.730501 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-e4d30037-f96e-4841-9e24-078fd58f14b5 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.1363964 May 25 15:48:12.932371 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-f53241bf-2008-410f-a1e3-a1ac81db73c8 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1002 time: 0.1876228 May 25 15:48:13.010700 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-88ef5cc8-cbe1-4e41-b4c0-cbb40b471133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:13.012822 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-88ef5cc8-cbe1-4e41-b4c0-cbb40b471133 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0592072 May 25 15:48:13.097236 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-46606c51-5c35-4705-a987-4909d74b32d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:13.099360 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-46606c51-5c35-4705-a987-4909d74b32d4 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0723243 May 25 15:48:13.247938 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-cf2d73ad-ef2a-46f8-b54e-ac6bbeb1f3cb service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1373460 May 25 15:48:13.450096 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b663b9cd-acfa-4942-be36-e4c06a00ffe5 req-1b9d7c55-2d85-4608-95b8-d36d42736c5f service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1861997 May 25 15:48:13.477887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 req-9639739d-3243-4f37-8f85-4d86bcd1e751 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:13.479321 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 req-9639739d-3243-4f37-8f85-4d86bcd1e751 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1101394 May 25 15:48:13.523829 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-661aeda3-b1ad-4bd7-9c2d-a8ad4f09ed63 req-21c07123-1ab5-4a6b-9e52-09b9d0ecdfef tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0387614 May 25 15:48:14.065544 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-bb4cabbb-4109-46ca-8d7b-c2ca87bd6fa3 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0759234 May 25 15:48:14.170156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-4054f6b7-247b-4f0a-a1de-9380aa8aae4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:14.171613 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-4054f6b7-247b-4f0a-a1de-9380aa8aae4e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 1099 time: 0.0735519 May 25 15:48:14.326399 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-781d5f96-2a23-4859-a0b8-5ffc8c3f63b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:14.327814 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-781d5f96-2a23-4859-a0b8-5ffc8c3f63b2 service neutron] 10.222.0.70 "GET /v2.0/networks?id=76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 200 len: 917 time: 0.1271317 May 25 15:48:14.437066 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-5c1138b3-5228-40b4-a8ed-d8296a9f8aa1 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 200 len: 1001 time: 0.0981712 May 25 15:48:14.512661 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-eddedfb0-3919-4ce0-b4cc-f8a790b68ffa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:14.514243 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-eddedfb0-3919-4ce0-b4cc-f8a790b68ffa service neutron] 10.222.0.70 "GET /v2.0/subnets?id=2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 200 len: 855 time: 0.0648129 May 25 15:48:14.602866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-4cbdf73b-adf1-42d6-9c9b-c3adef14bcdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:14.604285 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-4cbdf73b-adf1-42d6-9c9b-c3adef14bcdd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=76bea034-0890-4bf6-b793-280aaec1a32c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0759120 May 25 15:48:14.716349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727faaa6-578f-45b5-b8fd-46cac22c3713 req-55cdff9f-cbcb-4170-b069-e0174e7a4852 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:14.717832 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-727faaa6-578f-45b5-b8fd-46cac22c3713 req-55cdff9f-cbcb-4170-b069-e0174e7a4852 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0846291 May 25 15:48:14.763045 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-727faaa6-578f-45b5-b8fd-46cac22c3713 req-db10f7b3-d62a-459a-8926-29465ae0fa52 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0390859 May 25 15:48:15.861269 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-1755a5fb-c10e-46e6-9251-c476fc838fa0 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1374228 May 25 15:48:15.970316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171079d1-479f-448d-a3aa-2617d0a8108b req-272fae21-d830-496b-afae-3431e4e40382 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:15.971764 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-171079d1-479f-448d-a3aa-2617d0a8108b req-272fae21-d830-496b-afae-3431e4e40382 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0874832 May 25 15:48:16.019047 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-171079d1-479f-448d-a3aa-2617d0a8108b req-080b8f63-2474-439b-bb8f-8ed580d3e73c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411928 May 25 15:48:17.206586 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb6d683-3f06-4608-9d37-526bd38c7519 req-e0713b82-6342-466f-9331-a7aa3008eed8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:17.208072 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1cb6d683-3f06-4608-9d37-526bd38c7519 req-e0713b82-6342-466f-9331-a7aa3008eed8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0825331 May 25 15:48:17.251462 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1cb6d683-3f06-4608-9d37-526bd38c7519 req-28cd8403-00de-4b5f-8814-50be77a93de8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375347 May 25 15:48:18.486535 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-329214ed-d7fc-4136-97f6-7cdeb9a51e44 req-441477da-2cba-4659-97c1-6a001069dd69 service neutron] 10.222.0.70 "GET /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1871750 May 25 15:48:18.501756 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ab68d4-213d-4472-ba19-9846de6c3f11 req-1f5aac7f-1d89-490b-8073-406576b7dd54 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:18.503187 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2ab68d4-213d-4472-ba19-9846de6c3f11 req-1f5aac7f-1d89-490b-8073-406576b7dd54 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1335006 May 25 15:48:18.555081 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d2ab68d4-213d-4472-ba19-9846de6c3f11 req-b7458ea5-7fc2-4e45-93ec-2670f19362a8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463338 May 25 15:48:19.754997 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d40cda-9ab9-48f5-8677-6291cac4676d req-b6623ce0-5e4b-4c7d-a1c0-7656c950447e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:19.756499 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-30d40cda-9ab9-48f5-8677-6291cac4676d req-b6623ce0-5e4b-4c7d-a1c0-7656c950447e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0850956 May 25 15:48:19.801574 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-30d40cda-9ab9-48f5-8677-6291cac4676d req-939c9954-3f24-4cf1-9d5f-dbede6a7a1fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394001 May 25 15:48:20.365329 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 req-876b6f76-2071-4068-a806-37997da4e68e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:20.366772 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 req-876b6f76-2071-4068-a806-37997da4e68e tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0793116 May 25 15:48:20.415221 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9be0c76e-b6c9-4890-9c0f-fffb6dcba062 req-e0d068e2-59a6-4d97-a52a-fa0aa4f9bc30 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427115 May 25 15:48:21.066643 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 req-a5a9bcb4-04ff-45cc-acd2-3babd5c7448a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:21.068037 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 req-a5a9bcb4-04ff-45cc-acd2-3babd5c7448a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1583271 May 25 15:48:21.111052 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9bb6b55a-5722-45e1-9ec9-1dd5eb2832d2 req-a4f641b8-9e59-4fa0-9ef7-6258c2efa734 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0374320 May 25 15:48:21.597675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 req-d31afedf-a9da-4cf1-a46e-320346f6362f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:21.599138 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 req-d31afedf-a9da-4cf1-a46e-320346f6362f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0788319 May 25 15:48:21.641918 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ec0881c5-fc1f-4658-bf68-982ae657a1b5 req-807fe099-d894-4ca8-b37b-4fda75ee6352 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371368 May 25 15:48:22.297923 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401d2b71-396a-47d1-8bc2-dff46775dca5 req-d82ad35c-9f8b-4e09-8b77-5c58d6de89cc tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:22.299368 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-401d2b71-396a-47d1-8bc2-dff46775dca5 req-d82ad35c-9f8b-4e09-8b77-5c58d6de89cc tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0807393 May 25 15:48:22.343338 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-401d2b71-396a-47d1-8bc2-dff46775dca5 req-6e71fa89-1af1-4b2c-8747-c16be298a852 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382068 May 25 15:48:22.831496 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e req-94e74197-3a3f-456f-ad3a-b2f79adc90e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:22.832994 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e req-94e74197-3a3f-456f-ad3a-b2f79adc90e2 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0851908 May 25 15:48:22.876475 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ff6278d4-7301-4436-a8da-11f0ab9e1c4e req-56dea5de-93c1-4964-a06d-cd4ba829dc05 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378571 May 25 15:48:23.525614 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96cdff6a-e1b2-407b-830c-3cd6396ae25b req-e3231066-471c-4c1d-a211-c9bccea93633 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:23.527055 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-96cdff6a-e1b2-407b-830c-3cd6396ae25b req-e3231066-471c-4c1d-a211-c9bccea93633 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0794101 May 25 15:48:23.575269 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-96cdff6a-e1b2-407b-830c-3cd6396ae25b req-45ffec80-cdbc-4715-9c93-ff3b49aee569 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426705 May 25 15:48:24.058189 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b50f1500-975c-4803-8567-128ab9293d42 req-544fb09f-9a44-4603-af6d-16db0b738669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:24.059636 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b50f1500-975c-4803-8567-128ab9293d42 req-544fb09f-9a44-4603-af6d-16db0b738669 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0793273 May 25 15:48:24.103815 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b50f1500-975c-4803-8567-128ab9293d42 req-099414a2-d547-47b1-b0a6-8ab41b8d8897 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0369792 May 25 15:48:24.198396 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:24.315798 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:24.343537 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:24.352972 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:24.357303 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:24.359782 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-4f493752-9602-4535-8d35-492f7e0785a7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:24.396001 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'code': 200} May 25 15:48:24.433790 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=6']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:24.441598 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.441952 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.442294 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.442634 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.442966 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.443300 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.443627 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.443985 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.444315 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.444642 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.444977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.445285 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:24.449302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:24.760313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f req-a4147bc7-9b6e-4073-8992-49ecda2298c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:24.761781 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f req-a4147bc7-9b6e-4073-8992-49ecda2298c2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0838661 May 25 15:48:24.809661 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-24e63944-e2e9-4be3-8c4c-fcdc7d287d9f req-411282b8-9ed3-4fb5-bbf8-36a83b76af4f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0412230 May 25 15:48:25.162675 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-3a30f16a-537b-49f0-aaae-97d4c8da5ba5 service neutron] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1364238 May 25 15:48:25.184388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1c7d47-f367-41c9-91a0-4cf28360a88f req-6d4cbe91-24f8-493c-8365-d30c54b12f51 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:25.186514 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bc1c7d47-f367-41c9-91a0-4cf28360a88f req-6d4cbe91-24f8-493c-8365-d30c54b12f51 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0964694 May 25 15:48:25.241560 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bc1c7d47-f367-41c9-91a0-4cf28360a88f req-2557eaa2-632c-426e-a6e7-85ff4ec720ec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481203 May 25 15:48:25.313353 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf186d16-565c-4aa2-bd41-636a1660a52c req-2422cde2-0d0c-4523-8018-710cc44daedc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:25.314840 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bf186d16-565c-4aa2-bd41-636a1660a52c req-2422cde2-0d0c-4523-8018-710cc44daedc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0985067 May 25 15:48:25.367619 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bf186d16-565c-4aa2-bd41-636a1660a52c req-42f4d324-6f94-410d-81ae-452f44b5ab7f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469615 May 25 15:48:26.452294 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b075f9e2-e077-496c-b080-358364e5c361 req-d7c0d012-17a2-4077-8c4d-10247317eb30 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:26.453744 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b075f9e2-e077-496c-b080-358364e5c361 req-d7c0d012-17a2-4077-8c4d-10247317eb30 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0828645 May 25 15:48:26.500443 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b075f9e2-e077-496c-b080-358364e5c361 req-b3e3af94-e75c-42a6-b043-766d4a0bd62b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406015 May 25 15:48:26.558414 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 req-506b66d8-5bbe-4c4d-a49a-e044f2bc5cd5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:26.561895 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 req-506b66d8-5bbe-4c4d-a49a-e044f2bc5cd5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0888395 May 25 15:48:26.608983 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1413cb2-ad83-4b7f-beb7-742ce7134cf3 req-a5557896-4640-455f-9314-530f02b0b397 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412028 May 25 15:48:27.050754 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-a4ba6db7-8a6f-4fe7-9877-431a5be484bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:27.052240 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-a4ba6db7-8a6f-4fe7-9877-431a5be484bc tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 945 time: 0.0885782 May 25 15:48:27.198904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Deleting port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:27.199246 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:27.333610 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] For port a7d32eab-b1e5-4dcd-bb06-5f06e6841586, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:27.333970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:27.673428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:27.674180 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:27.674180 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Floating IP f9ed1275-5b92-458a-954d-b946214efa9e disassociated. External IP: 172.27.0.42, port: a7d32eab-b1e5-4dcd-bb06-5f06e6841586. May 25 15:48:27.674429 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling delete_port for a7d32eab-b1e5-4dcd-bb06-5f06e6841586 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:27.699311 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9106d4a-170f-4216-be33-75247be1a0c2 req-0543fb62-3bbf-4111-840f-6ca3ebccaf58 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:27.707157 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f9106d4a-170f-4216-be33-75247be1a0c2 req-0543fb62-3bbf-4111-840f-6ca3ebccaf58 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0976567 May 25 15:48:27.708747 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-ee5d6f73-63bf-43bb-90a5-6962438a59cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:27.710231 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-ee5d6f73-63bf-43bb-90a5-6962438a59cf service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901&tenant_id=9276d22c6df545f2a056d5059899b85f HTTP/1.1" status: 200 len: 1097 time: 0.1288447 May 25 15:48:27.751290 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f9106d4a-170f-4216-be33-75247be1a0c2 req-e52f919f-808c-475d-8e0c-6d98dc137e84 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432045 May 25 15:48:27.907826 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:27.915185 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-12943714-ec41-40d9-9d53-061959bd370a tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:27.968217 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'Port': ['ID=a7d32eab-b1e5-4dcd-bb06-5f06e6841586,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:27.989417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-823a8a52-9294-41bb-adb6-0949f5fb0d68 req-8824145c-ee80-45f1-afaf-0017b6d70b9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:27.990905 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-823a8a52-9294-41bb-adb6-0949f5fb0d68 req-8824145c-ee80-45f1-afaf-0017b6d70b9b tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 867 time: 0.2598505 May 25 15:48:27.994121 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.994506 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.994870 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.995227 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.995576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.995953 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.996305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.996651 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.996996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.997339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.997681 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:27.998058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:28.004112 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-95414b6b-f787-41b9-a112-fe647adaf068 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:28.005530 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-95414b6b-f787-41b9-a112-fe647adaf068 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1097 time: 0.2380135 May 25 15:48:28.006985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:28.278914 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-823a8a52-9294-41bb-adb6-0949f5fb0d68 req-21475443-cb5e-45b6-8f0c-c07717e99486 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups?id=4b54599f-0e93-4f9f-bb1a-60b25e29ab38&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2769368 May 25 15:48:28.415889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-ea555479-12b3-4779-a2cc-9c6beaaa7088 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:28.417269 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-ea555479-12b3-4779-a2cc-9c6beaaa7088 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.2863607 May 25 15:48:28.428522 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:48:28.608923 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-49a453c1-1dda-4df5-a4a5-148bdb0135d1 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1000 time: 0.1791985 May 25 15:48:28.757121 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-5c1ee446-435b-440e-84e0-765dcebed39b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:28.758617 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-5c1ee446-435b-440e-84e0-765dcebed39b service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0914702 May 25 15:48:28.759777 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:48:28.769130 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:48:28.779222 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:48:28.780919 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:48:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:28.881444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] No DVR routers for this DVR port a7d32eab-b1e5-4dcd-bb06-5f06e6841586 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:48:28.917674 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:28.921573 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'name': 'network-vif-deleted', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:28.955146 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7b0f8d1-cc31-4f36-806b-409f83fc9811 req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.70 "DELETE /v2.0/ports/a7d32eab-b1e5-4dcd-bb06-5f06e6841586 HTTP/1.1" status: 204 len: 173 time: 1.8896785 May 25 15:48:28.975444 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4b093877-20ab-4678-8d94-a89983bda325', 'name': 'network-vif-deleted', 'tag': 'a7d32eab-b1e5-4dcd-bb06-5f06e6841586', 'status': 'completed', 'code': 200} May 25 15:48:28.976587 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:48:28.985029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-f8be9ba5-83cc-4130-ab7d-587c144e9c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:28.986630 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-f8be9ba5-83cc-4130-ab7d-587c144e9c45 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1937752 May 25 15:48:29.004535 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a req-a92c515b-57ad-4bd1-9419-22f4dd5e2da0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:29.006031 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a req-a92c515b-57ad-4bd1-9419-22f4dd5e2da0 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.1329830 May 25 15:48:29.130102 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-88777d2e-a0dd-42b2-b6ef-4a8df3ce8b2a req-9901b124-09d3-4a9d-9831-b6405fbcaf58 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1170671 May 25 15:48:29.176656 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-a3dfe72f-2593-481d-b352-ed4ae8b92e44 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1500409 May 25 15:48:29.298023 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:29.302012 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:48:29.311421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:48:29.312068 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:48:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:29.334547 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d7fbabf0-aa66-413e-aa3c-ec2e63963169 req-ab7b2447-1041-495e-9395-18986041114e service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1346288 May 25 15:48:29.445194 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b43cac90-72c8-46eb-b504-c3b15aa2d368 req-0cc1c368-457b-450a-b4c7-45940171ea4f tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/ports?device_id=4b093877-20ab-4678-8d94-a89983bda325 HTTP/1.1" status: 200 len: 210 time: 0.0431519 May 25 15:48:29.502040 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:48:29.866753 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:29.871043 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5d121e1-366e-4c55-a05f-2f6a603f88ed None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:39:57Z', 'revision_number': 4, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '457c32e2-b449-47fd-84fd-f6192b685bb2', 'name': '', 'network_id': '320ad3f5-0f83-444c-8df0-70303c7a4446', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'mac_address': 'fa:16:3e:25:51:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_interface', 'standard_attr_id': 71, 'fixed_ips': [{'subnet_id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:56Z', 'updated_at': '2021-05-25T15:40:08Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'subnets': [{'id': '02ba8877-ef07-4ef0-b677-beca89c84dcb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:48:29.976067 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-76fad4e3-353c-4624-81e6-dd65effa28cb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:30.125174 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a137fda1-a4ea-43c8-946d-d48fd9d16be1 None None] New status for floating IP f9ed1275-5b92-458a-954d-b946214efa9e: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:48:30.131626 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 req-6bffaa89-b23d-42f3-8393-b907ba2a9745 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:30.133134 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 req-6bffaa89-b23d-42f3-8393-b907ba2a9745 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0821924 May 25 15:48:30.282382 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a2338e8c-16c3-47b6-bf31-fcbfbfcba766 req-308ca2ed-b34d-4295-a366-4e21573e6297 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434557 May 25 15:48:30.343272 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 req-b5d733dd-d130-4bc0-88ce-9861ba8fedb5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:30.344794 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 req-b5d733dd-d130-4bc0-88ce-9861ba8fedb5 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0895605 May 25 15:48:30.395458 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e09a7e6f-427b-4b1c-9b4e-2f6a1d0b3014 req-eb0583e4-6035-4bd9-88b6-86e0244d1a20 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449963 May 25 15:48:30.567700 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48934) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:30.630240 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:30.657662 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:30.709496 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:30.713236 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b76f275b-1228-4f55-abc1-8d82b4c7947d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:30.727281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b54599f-0e93-4f9f-bb1a-60b25e29ab38,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:30.730374 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:30.741622 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:30.742937 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /v2.0/security-groups/4b54599f-0e93-4f9f-bb1a-60b25e29ab38 HTTP/1.1" status: 204 len: 168 time: 0.1740863 May 25 15:48:30.745667 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48938) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:30.762374 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.api.v2.resource [None req-a892cf23-ae2c-4558-b4ef-e6b10bd9d43c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] show failed (client error): The resource could not be found. May 25 15:48:30.763308 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a892cf23-ae2c-4558-b4ef-e6b10bd9d43c tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "GET /v2.0/security-groups/4b54599f-0e93-4f9f-bb1a-60b25e29ab38 HTTP/1.1" status: 404 len: 347 time: 0.0166218 May 25 15:48:30.766346 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 48942) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:30.980381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Deleting port c20ee1c1-fc18-42ce-9810-28158e3de9d6 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:30.980606 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.096421 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.096747 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.221147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Calling delete_port for c20ee1c1-fc18-42ce-9810-28158e3de9d6 owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:31.332590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.337281 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9d4b5a2f-c233-4408-be42-eb8991018dc5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:31.379270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Pushing event deleted for resources: {'Port': ['ID=c20ee1c1-fc18-42ce-9810-28158e3de9d6,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:31.382107 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:31.528618 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.558021 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 req-c4dfd94a-1d76-46e9-a610-436a5205a1c5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:31.559479 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 req-c4dfd94a-1d76-46e9-a610-436a5205a1c5 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.1474123 May 25 15:48:31.561029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:31.562082 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] 10.222.0.36 "DELETE /v2.0/floatingips/f9ed1275-5b92-458a-954d-b946214efa9e HTTP/1.1" status: 204 len: 168 time: 0.7948427 May 25 15:48:31.594573 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 req-ea324788-955b-46a7-bb20-a89d03675c5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:31.596997 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 req-ea324788-955b-46a7-bb20-a89d03675c5b tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0931671 May 25 15:48:31.610542 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-eb08ac7c-a311-4e0e-b97e-93bc68fd9695 req-c4f09f01-781a-4131-b6b9-f2477ff9f4ea tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437658 May 25 15:48:31.644041 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b62b3a9d-9cc5-4b8e-98ac-5804c828e4e7 req-7ef71689-5fca-4333-91d1-c76fdeb2051d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399852 May 25 15:48:32.242233 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device a7d32eab-b1e5-4dcd-bb06-5f06e6841586 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:32.277570 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: a7d32eab-b1e5-4dcd-bb06-5f06e6841586 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:48:32.277923 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device a7d32eab-b1e5-4dcd-bb06-5f06e6841586 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:48:32.639910 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:32.695559 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0ef21a70-8f6b-4d68-952b-bfa022dc1448 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:32.807513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 req-cd010fe5-9510-479c-be6f-b1fc94265b16 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:32.809784 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 req-cd010fe5-9510-479c-be6f-b1fc94265b16 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.0852804 May 25 15:48:32.868416 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9d4b1e7d-f4f4-4f9f-9fde-66bb68bc27d6 req-02870504-ad62-479a-becf-f075c3b48ef6 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/security-groups?id=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530298 May 25 15:48:32.903096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-f17b7d8e-1a98-45ac-b065-c29e14e3930b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:32.905043 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-f17b7d8e-1a98-45ac-b065-c29e14e3930b tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 946 time: 0.2642264 May 25 15:48:32.920790 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 req-393e2f0d-c994-4833-94cd-18848c272bbc tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:32.920790 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 req-393e2f0d-c994-4833-94cd-18848c272bbc tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.1261621 May 25 15:48:33.059284 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca0e81b0-75df-4387-bc3b-900cd66ea2d1 req-093806b1-5e33-4930-9795-18f1597c74bd tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1065893 May 25 15:48:33.083836 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Deleting port 3def0d10-a624-4491-98d7-d5e621924663 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:33.084200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:33.215705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] For port 3def0d10-a624-4491-98d7-d5e621924663, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=3def0d10-a624-4491-98d7-d5e621924663,segment=NetworkSegment(915eeaf5-0ce1-4cff-820c-f43904e568be),segment_id=915eeaf5-0ce1-4cff-820c-f43904e568be)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:33.216007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:33.343518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Calling delete_port for 3def0d10-a624-4491-98d7-d5e621924663 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:33.453469 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:33.458770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-187f6715-a301-4619-bae0-8818b88e36f8 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:33.467136 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:33.470217 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['3def0d10-a624-4491-98d7-d5e621924663'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:48:33.504637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Pushing event deleted for resources: {'Port': ['ID=3def0d10-a624-4491-98d7-d5e621924663,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:33.508220 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:33.578566 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] No DVR routers for this DVR port 3def0d10-a624-4491-98d7-d5e621924663 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:48:33.580992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:33.583452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'name': 'network-vif-deleted', 'tag': '3def0d10-a624-4491-98d7-d5e621924663'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:33.598048 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f375e648-49e0-40e0-b2e7-a086a08e9462 req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.70 "DELETE /v2.0/ports/3def0d10-a624-4491-98d7-d5e621924663 HTTP/1.1" status: 204 len: 173 time: 0.6781859 May 25 15:48:33.629763 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b386291d-3fac-42b5-86f8-f307a4a5dc0f', 'name': 'network-vif-deleted', 'tag': '3def0d10-a624-4491-98d7-d5e621924663', 'status': 'completed', 'code': 200} May 25 15:48:34.026170 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-483a28af-838b-4744-bf54-24a46fab7c12 req-340577c6-82d2-41b8-a511-7779ea65b884 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Synchronizing usage tracker for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:48:34.041719 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-483a28af-838b-4744-bf54-24a46fab7c12 req-340577c6-82d2-41b8-a511-7779ea65b884 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Unset dirty status for tenant:fd3e84780cc8404caa2bc8b9b90bcfab on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:48:34.042906 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-483a28af-838b-4744-bf54-24a46fab7c12 req-340577c6-82d2-41b8-a511-7779ea65b884 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] 10.222.0.36 "GET /v2.0/ports?device_id=b386291d-3fac-42b5-86f8-f307a4a5dc0f HTTP/1.1" status: 200 len: 210 time: 0.0621459 May 25 15:48:34.249705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b req-5fb055fb-7e42-4713-ae0a-83008db7c83e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:34.251216 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b req-5fb055fb-7e42-4713-ae0a-83008db7c83e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0861089 May 25 15:48:34.304685 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e2570ad6-bc48-4e7e-9b1c-8e6c7a9e668b req-13ca0743-fcbb-43ce-b9df-4ed9b15afadc tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0459275 May 25 15:48:35.182172 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:35.538955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41767800-f531-4ea6-b460-6b673237b1be req-caec3633-e701-43f3-ba75-c9d1839a1beb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:35.541738 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-41767800-f531-4ea6-b460-6b673237b1be req-caec3633-e701-43f3-ba75-c9d1839a1beb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.1064658 May 25 15:48:35.588013 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-41767800-f531-4ea6-b460-6b673237b1be req-cd12d654-cc38-44bc-9c4a-e8e344448f49 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406439 May 25 15:48:35.608187 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49000) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:36.264988 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3def0d10-a624-4491-98d7-d5e621924663 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:36.276369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:36.301483 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 3def0d10-a624-4491-98d7-d5e621924663 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:48:36.301840 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 3def0d10-a624-4491-98d7-d5e621924663 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:48:36.681039 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Deleting port 457c32e2-b449-47fd-84fd-f6192b685bb2 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:36.681592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:36.785574 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d495807f-7176-4878-a55b-c9538bb9769b req-3d54826a-3ded-4db3-a47f-90ecd5b5187f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:36.787779 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d495807f-7176-4878-a55b-c9538bb9769b req-3d54826a-3ded-4db3-a47f-90ecd5b5187f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.0852618 May 25 15:48:36.808050 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] For port 457c32e2-b449-47fd-84fd-f6192b685bb2, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=457c32e2-b449-47fd-84fd-f6192b685bb2,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:36.808594 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:36.844867 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d495807f-7176-4878-a55b-c9538bb9769b req-d78fb586-33cc-4cdb-bd24-7bffe461b62d tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503528 May 25 15:48:36.944302 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Calling delete_port for 457c32e2-b449-47fd-84fd-f6192b685bb2 owned by network:router_interface {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:37.098849 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:37.102278 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:37.144855 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Pushing event deleted for resources: {'Port': ['ID=457c32e2-b449-47fd-84fd-f6192b685bb2,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:37.183001 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.183579 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.183978 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.184347 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.184708 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.185069 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.185423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.186467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.186831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.187186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.187541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.187914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:48:37.195249 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:37.430168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:37.895169 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Router 927291b5-83b6-4e30-b11f-71ca95ddef81 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:48:38.132615 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:48:38.142038 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23ffef6-fb81-44ae-99a5-f81074740071 req-9ab2416d-2f8b-446f-ae11-27ae91dbaac9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:38.142274 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Sync routers for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:48:38.143518 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c23ffef6-fb81-44ae-99a5-f81074740071 req-9ab2416d-2f8b-446f-ae11-27ae91dbaac9 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.1832576 May 25 15:48:38.151746 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:48:38.152398 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:48:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:38.168129 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1afda7d8-f45c-4993-abb0-31c053cbc510 admin admin] 10.222.0.36 "PUT /v2.0/routers/927291b5-83b6-4e30-b11f-71ca95ddef81/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5588515 May 25 15:48:38.170737 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49020) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:38.195177 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c23ffef6-fb81-44ae-99a5-f81074740071 req-4881092e-d453-4ccd-ab44-6401a63699a6 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445075 May 25 15:48:38.332499 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:48:38.350495 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:38.616955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:38.618984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226'}], 'enable_snat': True}, 'gw_port_id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:48:37Z', 'revision_number': 5, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port': {'id': 'c910cae2-a50e-4f9c-b6ab-2bc6ee721e26', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:84:10:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'device_owner': 'network:router_gateway', 'standard_attr_id': 66, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.226', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:52Z', 'updated_at': '2021-05-25T15:39:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:38.623168 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Checking router: 927291b5-83b6-4e30-b11f-71ca95ddef81 for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:48:38.632292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Routers {'927291b5-83b6-4e30-b11f-71ca95ddef81'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:48:38.632899 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:48:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['927291b5-83b6-4e30-b11f-71ca95ddef81'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:38.688373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Deleting port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:38.688373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:38.785057 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] Set router 927291b5-83b6-4e30-b11f-71ca95ddef81 gateway port host: None {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:48:38.812176 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] For port c910cae2-a50e-4f9c-b6ab-2bc6ee721e26, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:38.812176 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:38.888432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:48:38Z', 'revision_number': 6, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:38.893338 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-17f96914-aeff-47ed-b171-8fd192fd87d0 None None] The sync data for ids ['927291b5-83b6-4e30-b11f-71ca95ddef81'] in dv-cinder-791239-3-iscsi is: [{'id': '927291b5-83b6-4e30-b11f-71ca95ddef81', 'name': 'tempest-AttachVolumeTestJSON-1482065026-router', 'tenant_id': '42ea914db4fc4438a1d50bfff262a6e8', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:51Z', 'updated_at': '2021-05-25T15:48:38Z', 'revision_number': 6, 'project_id': '42ea914db4fc4438a1d50bfff262a6e8', 'gw_port_host': None}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:48:38.933595 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Calling delete_port for c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:39.197493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.200902 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5724aa6f-3a99-4435-b828-de2600171f48 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:39.245787 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Pushing event deleted for resources: {'Port': ['ID=c910cae2-a50e-4f9c-b6ab-2bc6ee721e26,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:39.254028 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:39.398785 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.576343 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.578896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.594639 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-250bcce4-3068-447b-bbf9-cf05c60bcaba req-f3155a92-9596-4e16-b7c9-0d432ff01ef2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:39.596076 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-250bcce4-3068-447b-bbf9-cf05c60bcaba req-f3155a92-9596-4e16-b7c9-0d432ff01ef2 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 944 time: 0.2793586 May 25 15:48:39.636034 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:48:39.640931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.641979 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 927291b5-83b6-4e30-b11f-71ca95ddef81 {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:48:39.672345 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-250bcce4-3068-447b-bbf9-cf05c60bcaba req-97b9d05c-516f-4cc8-aab8-151cb6df1157 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0655060 May 25 15:48:39.678834 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.682204 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] 10.222.0.36 "DELETE /v2.0/routers/927291b5-83b6-4e30-b11f-71ca95ddef81 HTTP/1.1" status: 204 len: 168 time: 1.5077715 May 25 15:48:39.682551 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49028) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:39.731236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:39.742965 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Deleting subnet 02ba8877-ef07-4ef0-b677-beca89c84dcb {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:48:39.745902 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.805025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.827082 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:48:39.827358 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device c910cae2-a50e-4f9c-b6ab-2bc6ee721e26 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:48:39.827779 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 457c32e2-b449-47fd-84fd-f6192b685bb2 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:39.864557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 457c32e2-b449-47fd-84fd-f6192b685bb2 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:48:39.864907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 457c32e2-b449-47fd-84fd-f6192b685bb2 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:48:39.888359 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:39.908945 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:39.926273 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'port_id': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'mac_address': 'fa:16:3e:ff:d2:a9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 358, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:48:39.984234 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.027616 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ae06ec7-6469-494a-b223-ce3de0a0e2da {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:48:40.049878 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:40.056862 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.058729 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-32077e05-456b-4959-be2f-addf9ddce3ae None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.123189 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=7']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:40.126226 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.183504 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.190938 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0cf8e6c8-d70b-46aa-938e-74126abf38f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.222731 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.227726 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-63579ba3-4963-4ba1-ae44-bb117069e312 None None] Network 320ad3f5-0f83-444c-8df0-70303c7a4446 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:48:40.230078 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=02ba8877-ef07-4ef0-b677-beca89c84dcb,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:40.232323 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.236419 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bdb8f98d-3db3-4719-a83f-ab788ed9b54e admin admin] 10.222.0.36 "DELETE /v2.0/subnets/02ba8877-ef07-4ef0-b677-beca89c84dcb HTTP/1.1" status: 204 len: 168 time: 0.5528431 May 25 15:48:40.237951 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49034) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:40.349195 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.427341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Deleting port e879beca-d836-4e54-858e-1247ed340ef1 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:40.427686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.479445 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] DHCP port deletion for 320ad3f5-0f83-444c-8df0-70303c7a4446 request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:48:40.530428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] For port e879beca-d836-4e54-858e-1247ed340ef1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e879beca-d836-4e54-858e-1247ed340ef1,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:40.530775 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.543516 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Deleting port e879beca-d836-4e54-858e-1247ed340ef1 {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:48:40.543927 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.647943 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] For port e879beca-d836-4e54-858e-1247ed340ef1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e879beca-d836-4e54-858e-1247ed340ef1,segment=NetworkSegment(c300b79c-ebf3-4aef-a927-fb0aa4b1ff23),segment_id=c300b79c-ebf3-4aef-a927-fb0aa4b1ff23)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:40.648626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.751775 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Calling delete_port for e879beca-d836-4e54-858e-1247ed340ef1 owned by network:dhcp {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:40.772027 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Calling delete_port for e879beca-d836-4e54-858e-1247ed340ef1 owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:48:40.803875 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.810135 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2fc3cd89-9e19-4609-b80d-a40749fc499f tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.823415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:40.828634 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:40.861155 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e req-89d14536-b8c0-455d-a9a2-65d4f0e40a04 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:40.862787 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e req-89d14536-b8c0-455d-a9a2-65d4f0e40a04 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 945 time: 0.0859449 May 25 15:48:40.864278 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Pushing event deleted for resources: {'Port': ['ID=e879beca-d836-4e54-858e-1247ed340ef1,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:40.872987 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.873840 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] No DVR routers for this DVR port e879beca-d836-4e54-858e-1247ed340ef1 on host dv-cinder-791239-3-iscsi {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:48:40.874517 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] No DVR routers for this DVR port e879beca-d836-4e54-858e-1247ed340ef1 on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:48:40.876045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Pushing event deleted for resources: {'Port': ['ID=e879beca-d836-4e54-858e-1247ed340ef1,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:40.878743 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-2e937b45-0336-44a8-aefd-af1195494505 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:40.924670 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-fdb0cce5-cd20-49a3-a7da-8fe93dff731e req-5dbfe57e-c6fe-4cf4-a198-00410e3705df tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496595 May 25 15:48:40.990567 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.006898 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['320ad3f5-0f83-444c-8df0-70303c7a4446']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:41.020022 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:41.020315 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c300b79c-ebf3-4aef-a927-fb0aa4b1ff23') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:48:41.031162 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.046582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.052443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Releasing vlan 364 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:48:41.052816 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:48:41.067026 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:48:41.143054 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.146703 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:41.165012 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.171501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Pushing event deleted for resources: {'Network': ['ID=320ad3f5-0f83-444c-8df0-70303c7a4446,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:41.175393 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:41.181263 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] 10.222.0.36 "DELETE /v2.0/networks/320ad3f5-0f83-444c-8df0-70303c7a4446 HTTP/1.1" status: 204 len: 168 time: 0.9422925 May 25 15:48:41.231818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['7ae06ec7-6469-494a-b223-ce3de0a0e2da'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:48:41.299078 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49046) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:41.347078 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-0509c642-714c-4415-a5ba-8b8a59094aff admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=42ea914db4fc4438a1d50bfff262a6e8&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0466862 May 25 15:48:41.349558 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49050) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:41.409770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.443076 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.471553 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e879beca-d836-4e54-858e-1247ed340ef1 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:48:41.496619 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.502234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8e367dac-443b-4cc4-8fe8-ecc94ff5f97d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:41.514958 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: e879beca-d836-4e54-858e-1247ed340ef1 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:48:41.515422 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a299b04f-f889-4ee3-90c4-b6d9f66140ea,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:41.515533 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e879beca-d836-4e54-858e-1247ed340ef1 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:48:41.517961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:41.530075 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:41.533667 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-9e2374cd-fc40-4b1a-ac6a-ccbda0ed6e3a admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/a299b04f-f889-4ee3-90c4-b6d9f66140ea HTTP/1.1" status: 204 len: 168 time: 0.1807625 May 25 15:48:42.123514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e req-7e9938bd-02b4-49eb-ba02-fc58331e3e78 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:42.125432 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e req-7e9938bd-02b4-49eb-ba02-fc58331e3e78 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 945 time: 0.0935624 May 25 15:48:42.178222 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1d50d5f-11f3-4ebd-abb4-abddd30e890e req-e9c78ad5-7fad-4617-9472-a0f85469c53e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468979 May 25 15:48:42.257604 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49080) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:42.361389 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1648190054-network', 'tenant_id': '6e1f97f6101d466a9c224075352387d8'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:48:42.365918 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:48:42.370403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Usage tracker for resource:network and tenant:6e1f97f6101d466a9c224075352387d8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:48:42.373543 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:48:42.379980 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:48:42.389854 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:48:42.393304 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.406972 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.422254 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:48:42.425999 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Usage tracker for resource:security_group_rule and tenant:6e1f97f6101d466a9c224075352387d8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:48:42.428819 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:48:42.434555 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:48:42.519954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.524403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.528771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1d69c406-ad95-4cc6-a8a9-57d4fea3bc49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:42.555890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 350} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:48:42.565019 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4539e613-a058-44ef-948a-29f99a8a94d7,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:42.568581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:42.571184 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.571526 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Added segment 2cf525b3-654f-4720-8254-63dec3a85366 of type vlan for network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 May 25 15:48:42.598174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.631647 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.633121 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:42.633768 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.637452 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e4b5fb70-d72d-4cd2-9d8d-1b88a51147d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:42.679812 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.746018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Pushing event updated for resources: {'Network': ['ID=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:42.750721 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4907544 May 25 15:48:42.750721 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-90257bff-24b7-462e-8444-3d5402a777aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:42.752419 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49090) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:48:42.756140 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:48:42.759672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Request body: {'subnet': {'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1648190054-subnet', 'tenant_id': '6e1f97f6101d466a9c224075352387d8', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:48:42.765381 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:48:42.769457 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Usage tracker for resource:subnet and tenant:6e1f97f6101d466a9c224075352387d8 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:48:42.772344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:48:42.778575 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:48:42.788452 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:48:42.790809 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:42.860691 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:48:42.932310 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 7ae06ec7-6469-494a-b223-ce3de0a0e2da triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:48:42.932694 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:43.052626 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:43.081403 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:43.091615 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:43.096982 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:43.099385 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-eddf622c-f165-4968-8390-1f1fea10c9a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:43.137845 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'code': 200} May 25 15:48:43.170602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=8']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:43.173522 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:43.290387 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:43.297349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:43.365946 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:43.369661 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:43.376625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dbfb272-6b15-4efa-9998-ed291cd2c547 req-86874558-c10b-4ef5-abf2-98a85154a11a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:43.377106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Checking segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:48:43.377106 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Network hostable DHCP agents. Network: 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:48:43.378152 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3dbfb272-6b15-4efa-9998-ed291cd2c547 req-86874558-c10b-4ef5-abf2-98a85154a11a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0870557 May 25 15:48:43.395581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:48:43.405823 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:48:43.415687 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:43.416489 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:43.418324 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-45aa1ec6-6c99-4297-991f-5249858e7306 None None] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:48:43.447437 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f9ccfb05-0fb0-4226-a46b-0739d9ba8d01 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.6873934 May 25 15:48:43.480495 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-3dbfb272-6b15-4efa-9998-ed291cd2c547 req-a2d8814a-2e9a-4488-a02f-e7ba5448a452 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0953894 May 25 15:48:43.512238 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b807c701-cbcc-48f0-9524-7674a90101cd req-951b7041-0e68-48af-bc7b-d54354e64cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:43.513916 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b807c701-cbcc-48f0-9524-7674a90101cd req-951b7041-0e68-48af-bc7b-d54354e64cf3 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.1061845 May 25 15:48:43.560484 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b807c701-cbcc-48f0-9524-7674a90101cd req-82ea5bb6-d7c7-4619-a3a5-9b2f5ec9a643 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0364408 May 25 15:48:43.660491 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1117aef-2fce-4fa4-8657-8e06fa9d87b3 None None] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:48:43.672285 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:48:44.008618 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-3f0ce1dc-fba9-48cf-8a01-06d8fdf2297f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:44.009714 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-3f0ce1dc-fba9-48cf-8a01-06d8fdf2297f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:network {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:48:44.027969 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-3f0ce1dc-fba9-48cf-8a01-06d8fdf2297f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:network {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:48:44.029204 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-3f0ce1dc-fba9-48cf-8a01-06d8fdf2297f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1833172 May 25 15:48:44.044015 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-53b49bd5-fa7c-4fb5-ab9e-da490c88925b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/quotas/6e1f97f6101d466a9c224075352387d8 HTTP/1.1" status: 200 len: 375 time: 0.0091317 May 25 15:48:44.098057 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-d733d6f6-36de-4189-8994-e694d568f557 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0487955 May 25 15:48:44.229825 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-ced7efaf-c155-40c2-ada4-8ef49eadaab1 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1250179 May 25 15:48:44.364218 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a3e7297f-5056-4d77-831c-681a49f810e2 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1286380 May 25 15:48:44.543431 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-e0015906-3531-4fc2-b4e8-e347f47ec2df req-1919ff60-dfd9-4f87-ac6a-fd09c4e51699 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 210 time: 0.0493548 May 25 15:48:44.688619 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9047c17f-27bf-4b60-8850-1bb69a1ba039 req-64af7898-8087-4826-8154-7ca718c5cded tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:44.690145 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9047c17f-27bf-4b60-8850-1bb69a1ba039 req-64af7898-8087-4826-8154-7ca718c5cded tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0916817 May 25 15:48:44.742157 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9047c17f-27bf-4b60-8850-1bb69a1ba039 req-f87cf637-f955-42de-9afe-8d10a564e69c tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456262 May 25 15:48:45.720707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9b943e1b-8a95-4404-9f3e-2ca19582fedb req-ce719ca9-754e-4ed4-99d5-4749ee5fc3e0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 210 time: 0.0676048 May 25 15:48:45.848929 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-94bdb842-b560-412b-87a5-caa2dd594e35 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:45.850376 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-94bdb842-b560-412b-87a5-caa2dd594e35 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1610622 May 25 15:48:45.866651 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Request body: {'port': {'device_id': 'fef24ea0-a934-410a-8440-614ba104efd6', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'admin_state_up': True, 'tenant_id': '6e1f97f6101d466a9c224075352387d8'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:48:45.956056 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e990bc-2577-4099-beac-54c4b25b5ab0 req-806337ce-902c-46b1-b880-d6393ba81ecf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:45.958004 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-82e990bc-2577-4099-beac-54c4b25b5ab0 req-806337ce-902c-46b1-b880-d6393ba81ecf tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0980692 May 25 15:48:46.003415 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-82e990bc-2577-4099-beac-54c4b25b5ab0 req-74fb1fe5-c207-4b53-8e0d-208cac8a4239 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394776 May 25 15:48:46.004577 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:48:46.008422 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Usage tracker for resource:port and tenant:6e1f97f6101d466a9c224075352387d8 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:48:46.011363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Quota usage for port was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:48:46.018138 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:48:46.027744 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:48:46.031695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:46.189059 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Allocated IP 172.20.0.8 (247feda9-7b6d-4c87-abaf-0b9c5d89f2d3/cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93/03200337-3a8d-470d-b921-cf873c06c54e) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:48:46.476894 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:46.505225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:46.511883 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:46.579304 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:48:46.582475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:48:46.585015 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:48:46.626782 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event updated for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:46.629728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:46.656707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:46.657325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:46.677644 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8149173 May 25 15:48:46.692791 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Request body: {'port': {'device_id': 'fef24ea0-a934-410a-8440-614ba104efd6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:48:46.816686 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.051467 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e2cd42-e37d-4634-a83c-59234b14a6a6 req-4c75729e-d452-4c19-9424-75f9fef90b37 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:47.052101 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-76e2cd42-e37d-4634-a83c-59234b14a6a6 req-4c75729e-d452-4c19-9424-75f9fef90b37 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:48:47.132164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-76e2cd42-e37d-4634-a83c-59234b14a6a6 req-4c75729e-d452-4c19-9424-75f9fef90b37 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:48:47.133330 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-76e2cd42-e37d-4634-a83c-59234b14a6a6 req-4c75729e-d452-4c19-9424-75f9fef90b37 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 931 time: 0.2960825 May 25 15:48:47.206506 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-76e2cd42-e37d-4634-a83c-59234b14a6a6 req-51c65ede-7d1a-43ed-bf17-fa19227d24a2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605924 May 25 15:48:47.280285 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 03200337-3a8d-470d-b921-cf873c06c54e {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:48:47.287457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.301600 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Transition to ACTIVE for port object 03200337-3a8d-470d-b921-cf873c06c54e will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:48:47.305198 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.308723 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-67d5e701-9f5d-40a6-b0e7-50c86d2531e6 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:47.430808 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Pushing event updated for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:47.456165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:47.538443 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Attempting to bind port 03200337-3a8d-470d-b921-cf873c06c54e on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:48:47.538770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Attempting to bind port 03200337-3a8d-470d-b921-cf873c06c54e by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:48:47.539094 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Attempting to bind port 03200337-3a8d-470d-b921-cf873c06c54e on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:48:47.543791 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Port 03200337-3a8d-470d-b921-cf873c06c54e on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:48:47.544148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Attempting to bind port 03200337-3a8d-470d-b921-cf873c06c54e on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:48:47.549889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 48, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:48:47.550234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Checking segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:48:47.550604 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Bound using segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:48:47.551003 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Bound port: 03200337-3a8d-470d-b921-cf873c06c54e, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:48:47.551348 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.639926 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:48:47.643742 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=03200337-3a8d-470d-b921-cf873c06c54e,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:48:47.647889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.651890 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-68cfd923-33e4-4440-9a35-42b11c202e0d tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:47.714073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:47.714851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:47.716241 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] 10.222.0.70 "PUT /v2.0/ports/03200337-3a8d-470d-b921-cf873c06c54e HTTP/1.1" status: 200 len: 1093 time: 1.0274632 May 25 15:48:47.717243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:47.735999 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Pushing event updated for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:47.738985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:47.761855 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e', 'status': 'completed', 'code': 200} May 25 15:48:48.396419 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 req-2828fe44-c0f9-47d5-8a3d-a2fb22844f35 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:48.397955 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 req-2828fe44-c0f9-47d5-8a3d-a2fb22844f35 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 943 time: 0.0820675 May 25 15:48:48.443960 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a4802a7f-02e8-48fb-a5ee-251eaac54de5 req-f4fc9fdd-d36f-429a-93f0-b893959981c5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397615 May 25 15:48:49.636049 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b479bf39-9ab3-4213-acd4-7b02f5d95955 req-ae4251ea-d240-4da6-877b-9a4ec3a75a9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:49.637573 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b479bf39-9ab3-4213-acd4-7b02f5d95955 req-ae4251ea-d240-4da6-877b-9a4ec3a75a9d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 943 time: 0.0787804 May 25 15:48:49.683939 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-b479bf39-9ab3-4213-acd4-7b02f5d95955 req-00bd87ff-ef9a-4950-901e-d10a7d0beac6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:security_group {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:48:49.699598 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-b479bf39-9ab3-4213-acd4-7b02f5d95955 req-00bd87ff-ef9a-4950-901e-d10a7d0beac6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:security_group {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:48:49.700755 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b479bf39-9ab3-4213-acd4-7b02f5d95955 req-00bd87ff-ef9a-4950-901e-d10a7d0beac6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569224 May 25 15:48:50.762691 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-9ec78510-e6ca-4ced-8a5b-e3e486de266e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:50.764248 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-9ec78510-e6ca-4ced-8a5b-e3e486de266e service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 1096 time: 0.0731785 May 25 15:48:50.956888 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-7638ff89-d63d-46de-9c27-c3d264174a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:50.958311 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-7638ff89-d63d-46de-9c27-c3d264174a8e service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=6e1f97f6101d466a9c224075352387d8&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1857405 May 25 15:48:50.970452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 req-9ec12b48-3a6d-428c-be09-ecd472753928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:50.971778 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 req-9ec12b48-3a6d-428c-be09-ecd472753928 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 943 time: 0.1325610 May 25 15:48:51.192768 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2ef5c8ae-192a-48b6-a6f4-3e6234ec35e5 req-5fb33b2f-959c-4cec-a96d-9916829fcc4c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2004261 May 25 15:48:51.234400 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-eeee4526-70d7-40b8-a063-3e40100833c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:51.235886 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-244f6ac3-215e-4c1c-b746-73c2ad59e009 req-eeee4526-70d7-40b8-a063-3e40100833c8 service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2632511 May 25 15:48:51.350080 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-c88e4dcc-9c9f-475c-a65b-ff35f4df12a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:51.351540 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-c88e4dcc-9c9f-475c-a65b-ff35f4df12a4 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 1096 time: 0.0702462 May 25 15:48:51.427194 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-2d3982ef-b838-4b2e-b17e-9731965c7c08 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=03200337-3a8d-470d-b921-cf873c06c54e HTTP/1.1" status: 200 len: 217 time: 0.0658517 May 25 15:48:51.492791 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-8f6c1b8d-bd41-4042-9643-0dcbf812db49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:51.494229 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-8f6c1b8d-bd41-4042-9643-0dcbf812db49 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0577300 May 25 15:48:51.547492 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-2ec42f5d-47e6-4123-ac55-8baa8c113dbd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0449805 May 25 15:48:51.696600 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-4c6edd00-1100-413e-b684-35af3e7c261d service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1413589 May 25 15:48:51.830166 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aea0f46f-2309-441a-81f1-8d8e021f89ac req-79d75f3c-075e-4d06-ae9f-e92024f07bef service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242321 May 25 15:48:52.378300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-544302b1-6c82-4218-b767-3b94ada7c7a2 req-7e13eb46-3764-4fec-9312-e728f5b2b658 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:52.379728 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-544302b1-6c82-4218-b767-3b94ada7c7a2 req-7e13eb46-3764-4fec-9312-e728f5b2b658 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 943 time: 0.0788414 May 25 15:48:52.424805 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-544302b1-6c82-4218-b767-3b94ada7c7a2 req-bfea8f1b-8823-41a6-9a47-3919e7cef480 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394437 May 25 15:48:53.465984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 03200337-3a8d-470d-b921-cf873c06c54e details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:48:53.602076 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=03200337-3a8d-470d-b921-cf873c06c54e,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:53.615345 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '03200337-3a8d-470d-b921-cf873c06c54e', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'port_id': '03200337-3a8d-470d-b921-cf873c06c54e', 'mac_address': 'fa:16:3e:cf:74:4d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:48:53.618508 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 req-3d02ff2c-950e-4b80-9eab-9217ca029249 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:53.620000 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 req-3d02ff2c-950e-4b80-9eab-9217ca029249 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 943 time: 0.0836906 May 25 15:48:53.667880 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fdb89dd6-f0ce-4737-bb7e-7c7be9ab4e70 req-0974e4c6-c29f-418f-8578-fef29fe5e1a6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386875 May 25 15:48:53.673214 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:53.690557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 03200337-3a8d-470d-b921-cf873c06c54e {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:48:53.705313 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=03200337-3a8d-470d-b921-cf873c06c54e,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:53.709293 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:53.711020 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:53.774004 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:53.776991 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.066s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:54.052594 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:48:54.997533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd req-22ed62e0-0d80-4a88-93c1-4d9dbe42c52e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:54.999561 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd req-22ed62e0-0d80-4a88-93c1-4d9dbe42c52e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 944 time: 0.0837507 May 25 15:48:55.041504 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1b9f2656-8c33-4f8c-bf54-b599898cc3cd req-80104809-93f7-4c8c-a8fd-9d5f6ef955ec tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0363994 May 25 15:48:55.482616 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 03200337-3a8d-470d-b921-cf873c06c54e up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:48:55.548819 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 03200337-3a8d-470d-b921-cf873c06c54e completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:48:55.553170 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 03200337-3a8d-470d-b921-cf873c06c54e triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:48:55.553547 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:55.675247 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:55.702578 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:48:55.712202 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=03200337-3a8d-470d-b921-cf873c06c54e,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:48:55.717367 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:48:55.719327 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-1a52191f-3ae4-4af6-b47f-515c23ed5686 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:48:55.750078 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e', 'code': 200} May 25 15:48:55.789612 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:48:55.792536 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:48:56.002952 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16243da-ba3d-40b6-9b02-d1cef52e954e req-9221eb41-2ae7-4eaa-9143-ceda0e30c5e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:56.004452 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a16243da-ba3d-40b6-9b02-d1cef52e954e req-9221eb41-2ae7-4eaa-9143-ceda0e30c5e3 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 1098 time: 0.0696931 May 25 15:48:56.051697 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a16243da-ba3d-40b6-9b02-d1cef52e954e req-fa1c2ebc-f099-4b8b-a63f-92008690e46e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375051 May 25 15:48:56.223120 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 req-b115845e-52ff-4516-bc0f-3f5d1c966e89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:56.224596 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 req-b115845e-52ff-4516-bc0f-3f5d1c966e89 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 945 time: 0.0804398 May 25 15:48:56.268076 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b719826a-a0bc-4c1d-ae15-aac6a333fe67 req-1591c278-e18b-4244-8099-6e1285e83ad2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378375 May 25 15:48:57.475428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35d66e1f-c588-4c13-a457-36dfe3a63b4b req-8a5439c2-7463-4d2c-a29a-0b51b90ce430 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:48:57.476918 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-35d66e1f-c588-4c13-a457-36dfe3a63b4b req-8a5439c2-7463-4d2c-a29a-0b51b90ce430 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 945 time: 0.0914428 May 25 15:48:57.522588 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-35d66e1f-c588-4c13-a457-36dfe3a63b4b req-33a2c99e-b6ef-4502-9924-06bc5b1c9e43 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399523 May 25 15:48:59.969153 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6719c7cf-5bae-46ce-848d-069c4877596f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:01.639451 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49288) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:01.706847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Deleting subnet cc10550a-268b-4838-b7df-f6dc84fd8286 {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:49:01.709834 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:01.760070 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:01.815511 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.149933 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.155143 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d0d0f374-0509-45c8-9b41-002245e8ea25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:02.190268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cc10550a-268b-4838-b7df-f6dc84fd8286,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:02.192215 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.194659 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:02.198952 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-132f623f-d7b6-4a8c-a144-7d2d4ab11e94 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/cc10550a-268b-4838-b7df-f6dc84fd8286 HTTP/1.1" status: 204 len: 168 time: 0.5583112 May 25 15:49:02.201235 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49294) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:02.305614 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.433110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.445515 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3c515845-6e63-4d8b-b829-eb7af03f0236']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:02.457805 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '915eeaf5-0ce1-4cff-820c-f43904e568be') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:02.458103 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '915eeaf5-0ce1-4cff-820c-f43904e568be') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:02.469771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.485301 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.491177 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Releasing vlan 390 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:49:02.491558 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:49:02.504994 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:49:02.582334 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.587388 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.589893 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-54010579-7ea6-4ef2-8bf2-0902f92b5000 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:02.611471 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Pushing event deleted for resources: {'Network': ['ID=3c515845-6e63-4d8b-b829-eb7af03f0236,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:02.614287 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:02.618577 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bf031a5f-3d74-4885-be12-ed2cba4339ff admin admin] 10.222.0.36 "DELETE /v2.0/networks/3c515845-6e63-4d8b-b829-eb7af03f0236 HTTP/1.1" status: 204 len: 168 time: 0.4162469 May 25 15:49:02.644546 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.688379 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-fd933426-5909-4b79-8270-3dd14c2bf88d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.734887 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49300) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:02.783244 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e6b94496-045e-4646-bfe8-0f19f19000fc admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=fd3e84780cc8404caa2bc8b9b90bcfab&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0471187 May 25 15:49:02.785622 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49304) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:02.843290 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.869118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.921546 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.926242 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-252de861-1acd-4f9d-aa95-aef60e0a4548 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:02.940272 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51a765e4-2a77-4cfc-a3ba-f31b87a1fc80,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:02.943430 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:02.949521 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:02.950638 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-8c303971-ba2d-42a8-a9bc-c04bdc3f5386 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/51a765e4-2a77-4cfc-a3ba-f31b87a1fc80 HTTP/1.1" status: 204 len: 168 time: 0.1640894 May 25 15:49:03.466567 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:05.184977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:05.241453 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bae662f-477d-4f5c-8d6e-a78a39114654 req-33b875c1-94d5-4c11-99e0-bc577e2d57f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:05.242932 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7bae662f-477d-4f5c-8d6e-a78a39114654 req-33b875c1-94d5-4c11-99e0-bc577e2d57f2 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.0843892 May 25 15:49:05.287214 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7bae662f-477d-4f5c-8d6e-a78a39114654 req-7e9a6f64-8938-407a-aef3-64553a14fadc tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385642 May 25 15:49:06.482140 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa54f28-3cda-4509-baf2-d1761b68d338 req-ad03c1ca-4118-481b-9be5-5e934a8cc887 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:06.484385 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1aa54f28-3cda-4509-baf2-d1761b68d338 req-ad03c1ca-4118-481b-9be5-5e934a8cc887 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.0850761 May 25 15:49:06.531602 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1aa54f28-3cda-4509-baf2-d1761b68d338 req-02eda95c-b21d-432c-b44a-9a4f19f9a51a tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401623 May 25 15:49:07.551202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-68eb0468-1c50-47bb-82e5-ca03a8c6a40e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:07.553089 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-68eb0468-1c50-47bb-82e5-ca03a8c6a40e tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.0803010 May 25 15:49:07.590885 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-c11145b8-75bf-4758-aa58-6f93917c6fdb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:07.592471 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-c11145b8-75bf-4758-aa58-6f93917c6fdb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1499984 May 25 15:49:07.607221 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-5f92b4db-8f9b-4ee1-a0f3-4c8aa7dcd034 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/quotas/6e1f97f6101d466a9c224075352387d8 HTTP/1.1" status: 200 len: 375 time: 0.0090632 May 25 15:49:07.693705 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-7b921be4-267d-4e69-8d09-f9b71d2e60f0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0799859 May 25 15:49:07.758605 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Deleting port 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:07.758945 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:07.835821 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-fcb6e6c8-8515-4611-afd5-bfa5c20d7e21 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353161 May 25 15:49:07.838518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb req-ce4b3c18-38f2-448b-970a-0608014b8517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:07.840007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb req-ce4b3c18-38f2-448b-970a-0608014b8517 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 946 time: 0.1764560 May 25 15:49:07.917536 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cf3b66bd-87a0-4f62-b85a-ecf409d80bdb req-f6e8889b-5dd6-42be-abbd-2ff80e9cfac7 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups?id=4277f837-3eba-4c09-8333-b372c64011aa&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0695460 May 25 15:49:07.941041 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] For port 8c3b5d16-b63c-438e-a031-8606d9e7796f, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=8c3b5d16-b63c-438e-a031-8606d9e7796f,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:07.941613 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:07.970695 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-605a1804-4b06-4835-87bc-8804ac59cff9 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1286578 May 25 15:49:08.249684 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-cc68b863-d411-4832-b98f-5cfa4c145df0 req-0814c8e5-4154-4dd7-98a6-c4f8584efe2e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 210 time: 0.0615640 May 25 15:49:08.377744 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:08.378119 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:08.378434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Floating IP 1158e8c8-9148-4b96-9327-a3c1359a3fa8 disassociated. External IP: 172.27.0.234, port: 8c3b5d16-b63c-438e-a031-8606d9e7796f. May 25 15:49:08.378774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling delete_port for 8c3b5d16-b63c-438e-a031-8606d9e7796f owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:08.495132 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:08.500714 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fe28a703-87af-46d5-91a0-f0c68f7f738a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:08.548263 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'Port': ['ID=8c3b5d16-b63c-438e-a031-8606d9e7796f,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:08.551722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:08.736191 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:49:08.918472 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:49:08.927669 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:49:08.938355 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:49:08.938980 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:49:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:08.998728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] No DVR routers for this DVR port 8c3b5d16-b63c-438e-a031-8606d9e7796f on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:49:09.001920 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:09.012476 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-deleted', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:09.022601 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d9bbafe3-699a-44bc-ab29-13a85c5526ce req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.70 "DELETE /v2.0/ports/8c3b5d16-b63c-438e-a031-8606d9e7796f HTTP/1.1" status: 204 len: 173 time: 1.4567719 May 25 15:49:09.085165 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c657feea-6b2e-48ce-a311-464e6b956e0e', 'name': 'network-vif-deleted', 'tag': '8c3b5d16-b63c-438e-a031-8606d9e7796f', 'status': 'completed', 'code': 200} May 25 15:49:09.089451 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-efba7eed-a73c-4151-b34c-ec74eb3983db req-c130442d-938c-4393-99e6-285f2f7275aa tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/ports?device_id=c657feea-6b2e-48ce-a311-464e6b956e0e HTTP/1.1" status: 200 len: 210 time: 0.0499911 May 25 15:49:09.144469 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:49:09.418817 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-80b12db9-ef53-436a-a976-00bf858eb024 req-7b6e133a-83eb-45b0-9582-fb84cfd0fb0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 210 time: 0.0524256 May 25 15:49:09.463335 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:09.467352 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:49:09.475731 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:49:09.476366 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:49:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:09.550154 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-481bb67e-9302-40d2-86a8-c9dfd1e0f3ba tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:09.551804 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-481bb67e-9302-40d2-86a8-c9dfd1e0f3ba tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.2104025 May 25 15:49:09.574476 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Request body: {'port': {'device_id': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'admin_state_up': True, 'tenant_id': '6e1f97f6101d466a9c224075352387d8'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:09.661423 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:49:09.712637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:09.722030 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:09.733180 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:09.736731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:09.915267 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Allocated IP 172.20.0.7 (247feda9-7b6d-4c87-abaf-0b9c5d89f2d3/cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93/6fd10c0b-7953-4682-8b93-6b38d31fbca5) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:49:10.020811 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:10.024823 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c55f25a-2e42-4ca6-812b-8e5b0fc0175b None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:40:10Z', 'revision_number': 4, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'e92dc1c3-6a99-4b16-85a6-e348d26267f4', 'name': '', 'network_id': '76bea034-0890-4bf6-b793-280aaec1a32c', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'mac_address': 'fa:16:3e:17:0c:8d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 95, 'fixed_ips': [{'subnet_id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:40:06Z', 'updated_at': '2021-05-25T15:40:24Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'subnets': [{'id': '2ce66291-0ef8-4b15-9e67-ba32027661fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:49:10.230483 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49372) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:10.256621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-92b369cd-da5a-4c9e-b98d-530242e1891a None None] New status for floating IP 1158e8c8-9148-4b96-9327-a3c1359a3fa8: DOWN {{(pid=98464) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:49:10.257410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.287644 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.293363 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.318456 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.349043 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.362458 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:49:10.365549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:10.370146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:49:10.401608 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event updated for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:10.407892 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:10.409483 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:10.413063 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.418250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2429f427-b1d3-4f2b-9cdb-703e4d905370 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:10.438053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4277f837-3eba-4c09-8333-b372c64011aa,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:10.438696 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:10.439943 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.441196 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:10.452772 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.454020 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /v2.0/security-groups/4277f837-3eba-4c09-8333-b372c64011aa HTTP/1.1" status: 204 len: 168 time: 0.2195427 May 25 15:49:10.456558 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49378) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:10.472589 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9021947 May 25 15:49:10.481179 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.api.v2.resource [None req-6c30ca5a-91a3-44c2-bfbc-f6a399bb4477 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] show failed (client error): The resource could not be found. May 25 15:49:10.482173 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6c30ca5a-91a3-44c2-bfbc-f6a399bb4477 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "GET /v2.0/security-groups/4277f837-3eba-4c09-8333-b372c64011aa HTTP/1.1" status: 404 len: 347 time: 0.0238605 May 25 15:49:10.485660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49382) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:10.486847 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Request body: {'port': {'device_id': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:10.616700 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.884912 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ef2d94-28bb-4d1f-b630-0a200513f991 req-d3fe9d0b-5520-4b26-9883-672dc7389ec2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:10.886381 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-51ef2d94-28bb-4d1f-b630-0a200513f991 req-d3fe9d0b-5520-4b26-9883-672dc7389ec2 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 931 time: 0.1511688 May 25 15:49:10.892709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Deleting port 45625dae-4077-4658-85ab-556282c8aea8 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:10.893053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.971574 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6fd10c0b-7953-4682-8b93-6b38d31fbca5 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:10.979286 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:10.993853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Transition to ACTIVE for port object 6fd10c0b-7953-4682-8b93-6b38d31fbca5 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:49:10.997587 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.002845 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-84dcf37a-b515-4b8d-bb8a-25b3901efa65 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:11.024453 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-51ef2d94-28bb-4d1f-b630-0a200513f991 req-a7c7b497-bb59-4516-8628-840451970131 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1149201 May 25 15:49:11.053874 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.054209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.162950 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Pushing event updated for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:11.166225 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:11.178146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Calling delete_port for 45625dae-4077-4658-85ab-556282c8aea8 owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:11.235690 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Attempting to bind port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:49:11.236081 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Attempting to bind port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:49:11.236431 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Attempting to bind port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:11.241587 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:49:11.241910 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Attempting to bind port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:11.247006 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 48, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:49:11.247349 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Checking segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:11.252228 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Bound using segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:49:11.252789 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Bound port: 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:49:11.253271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.293099 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.304113 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eb20ac2d-8cb8-4e74-8b2e-8355637af6b7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:11.346933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:49:11.350250 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:49:11.353313 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Pushing event deleted for resources: {'Port': ['ID=45625dae-4077-4658-85ab-556282c8aea8,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:11.354852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.359027 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-83f80da6-b95a-481a-893c-09a52ea71f37 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:11.379386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:11.424510 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:11.424697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.426064 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] 10.222.0.70 "PUT /v2.0/ports/6fd10c0b-7953-4682-8b93-6b38d31fbca5 HTTP/1.1" status: 200 len: 1093 time: 0.9440613 May 25 15:49:11.426565 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:11.444448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Pushing event updated for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:11.452690 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:11.459877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.475127 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:11.476292 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a90ecd3f-8a85-46fe-a41a-e474d11a8823 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] 10.222.0.36 "DELETE /v2.0/floatingips/1158e8c8-9148-4b96-9327-a3c1359a3fa8 HTTP/1.1" status: 204 len: 168 time: 0.9897470 May 25 15:49:11.513146 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5', 'status': 'completed', 'code': 200} May 25 15:49:11.555493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-b68c4245-5814-4080-b917-7596f2b601ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:11.557031 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-b68c4245-5814-4080-b917-7596f2b601ba service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 1096 time: 0.0745018 May 25 15:49:11.609228 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:49:11.634033 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-a9261e23-086e-4a72-b0e1-289b46740181 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5 HTTP/1.1" status: 200 len: 217 time: 0.0654609 May 25 15:49:11.648114 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 8c3b5d16-b63c-438e-a031-8606d9e7796f {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:49:11.648796 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 8c3b5d16-b63c-438e-a031-8606d9e7796f not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:49:11.705461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-ba9c4de3-00c4-42f1-b783-098501940831 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:11.706933 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-ba9c4de3-00c4-42f1-b783-098501940831 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0644057 May 25 15:49:11.763512 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-48a5fdc0-3c3c-4cf7-9fee-662ee0d3a1b0 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0433557 May 25 15:49:11.903157 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-9e231425-17e4-4b8c-b198-0348f11b96ae service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1286776 May 25 15:49:12.044077 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8e0a45bc-c6a6-48d1-bad7-a76da017e5ac req-2b1dc7a8-baa3-43ef-bd7c-0f64ec13b485 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1340075 May 25 15:49:12.218441 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1389db-33b8-4ad4-af27-5eb12167be49 req-f3729dc7-eaed-4245-bb84-c6dbd1cc97e1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:12.219974 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7a1389db-33b8-4ad4-af27-5eb12167be49 req-f3729dc7-eaed-4245-bb84-c6dbd1cc97e1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 943 time: 0.0876772 May 25 15:49:12.266046 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7a1389db-33b8-4ad4-af27-5eb12167be49 req-bc755a0e-5321-43e7-b6ac-7c89a6e3bfa9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399101 May 25 15:49:12.274240 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4f3f88-c952-4371-973b-9763077619aa req-abf56f1e-ddf4-4700-8c6c-186aeae5254d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:12.275695 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-abf56f1e-ddf4-4700-8c6c-186aeae5254d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 1096 time: 0.1668200 May 25 15:49:12.418273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4f3f88-c952-4371-973b-9763077619aa req-eee2d2b3-b813-4253-9f1b-6aeb42d30bc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:12.420310 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-eee2d2b3-b813-4253-9f1b-6aeb42d30bc8 service neutron] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 916 time: 0.1260724 May 25 15:49:12.493488 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-e678cd35-5d2c-4363-96a6-4a70d78bc7ae service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5 HTTP/1.1" status: 200 len: 217 time: 0.0643396 May 25 15:49:12.555096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4f3f88-c952-4371-973b-9763077619aa req-2b93c8ff-a93d-4d5c-b046-26088a7fb8f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:12.556433 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-2b93c8ff-a93d-4d5c-b046-26088a7fb8f5 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0566673 May 25 15:49:12.604291 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-771920ee-feb0-4c76-af78-570fd8e098bd service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0396688 May 25 15:49:12.681848 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:12.737254 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-2ffa6fde-b220-4304-934b-64e520c1e661 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1257188 May 25 15:49:12.877159 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aa4f3f88-c952-4371-973b-9763077619aa req-bea70974-db84-4598-bc07-24c12319560d service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279714 May 25 15:49:13.460373 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e req-6fa328db-f0ef-4736-ac3e-abee4456a080 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:13.461055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e req-6fa328db-f0ef-4736-ac3e-abee4456a080 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:49:13.475385 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e req-6fa328db-f0ef-4736-ac3e-abee4456a080 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:49:13.476525 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e req-6fa328db-f0ef-4736-ac3e-abee4456a080 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 943 time: 0.0997906 May 25 15:49:13.521578 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-71bc3464-14ba-4cdf-83d4-ce80f69fab1e req-2beb9209-a9a2-4ca7-a8fc-e6d1adf8e0a4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394685 May 25 15:49:13.618191 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6fd10c0b-7953-4682-8b93-6b38d31fbca5 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:49:13.782751 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:13.795932 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '6fd10c0b-7953-4682-8b93-6b38d31fbca5', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'port_id': '6fd10c0b-7953-4682-8b93-6b38d31fbca5', 'mac_address': 'fa:16:3e:7d:bc:19', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:49:13.852857 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:13.869499 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6fd10c0b-7953-4682-8b93-6b38d31fbca5 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:13.885237 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:13.889538 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:13.891583 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:13.958784 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:13.961667 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:14.239031 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['6fd10c0b-7953-4682-8b93-6b38d31fbca5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:14.256676 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49414) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:14.858038 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 req-f9c6f0e2-1320-4095-8ee2-e79ed9061f58 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:14.860507 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 req-f9c6f0e2-1320-4095-8ee2-e79ed9061f58 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 944 time: 0.2111218 May 25 15:49:14.954750 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d3d76d69-5fa6-4a6f-a082-c86a6a690d87 req-68943f53-bb0c-439d-b756-2da4fa6fceb9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0838788 May 25 15:49:15.159012 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.566792 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Deleting port e92dc1c3-6a99-4b16-85a6-e348d26267f4 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:15.567444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.625024 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6fd10c0b-7953-4682-8b93-6b38d31fbca5 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:49:15.698091 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:49:15.698796 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] For port e92dc1c3-6a99-4b16-85a6-e348d26267f4, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=e92dc1c3-6a99-4b16-85a6-e348d26267f4,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:15.699184 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.703578 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:49:15.704029 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.830415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.837270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Calling delete_port for e92dc1c3-6a99-4b16-85a6-e348d26267f4 owned by network:router_interface {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:15.866240 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:15.877317 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:15.883629 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:15.885704 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:15.917205 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5', 'code': 200} May 25 15:49:15.957502 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:15.960271 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:16.018935 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:16.023874 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-21dd2dd1-472e-4530-b769-6200f60c55b5 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:16.076545 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Pushing event deleted for resources: {'Port': ['ID=e92dc1c3-6a99-4b16-85a6-e348d26267f4,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:16.132976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:16.191941 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32488a8c-1019-40c9-bcee-e43c642f51d1 req-5a133b98-341b-4ed7-a092-29c34c5b7bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:16.194130 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32488a8c-1019-40c9-bcee-e43c642f51d1 req-5a133b98-341b-4ed7-a092-29c34c5b7bc4 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 1098 time: 0.0852327 May 25 15:49:16.256183 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-32488a8c-1019-40c9-bcee-e43c642f51d1 req-e7017773-7601-455d-a1ef-41ca6ee2d42e service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479021 May 25 15:49:16.322492 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2668726b-d9a8-497b-be28-99310d4e56bf req-7ecb404f-73ba-4b60-9622-12a645d47b1c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:16.324183 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2668726b-d9a8-497b-be28-99310d4e56bf req-7ecb404f-73ba-4b60-9622-12a645d47b1c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.2502689 May 25 15:49:16.451263 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2668726b-d9a8-497b-be28-99310d4e56bf req-43ef584b-d999-40c9-8be0-ee90b1ffed37 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195858 May 25 15:49:16.453271 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:16.914681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:49:17.089981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:49:17.098034 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Sync routers for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:49:17.101853 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f92e8c97-6e8d-42d9-b8c2-5a1459c89ef8 admin admin] 10.222.0.36 "PUT /v2.0/routers/033b53ca-9c17-4a0e-bdce-e24dc83318d6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8441427 May 25 15:49:17.104403 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49426) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:17.107265 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:49:17.107884 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:49:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:17.280737 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks [] for router, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:17.282561 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:49:17.461373 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:17.565108 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Deleting port 7de68007-656f-4ebe-b48c-f94f0b3d44e1 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:17.565500 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:17.595280 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190'}], 'enable_snat': True}, 'gw_port_id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:49:15Z', 'revision_number': 5, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port': {'id': '7de68007-656f-4ebe-b48c-f94f0b3d44e1', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:40:07:cb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:39:55Z', 'updated_at': '2021-05-25T15:40:14Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:17.599953 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Checking router: 033b53ca-9c17-4a0e-bdce-e24dc83318d6 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:49:17.610130 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Routers {'033b53ca-9c17-4a0e-bdce-e24dc83318d6'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:49:17.611145 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:49:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:17.665547 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f9f7434-3e50-408f-8370-6b70e53395bb req-5880f185-0506-4313-ac0d-b7e9b369c177 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:17.667906 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5f9f7434-3e50-408f-8370-6b70e53395bb req-5880f185-0506-4313-ac0d-b7e9b369c177 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.0868161 May 25 15:49:17.696715 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] For port 7de68007-656f-4ebe-b48c-f94f0b3d44e1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=7de68007-656f-4ebe-b48c-f94f0b3d44e1,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:17.696976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:17.715228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5f9f7434-3e50-408f-8370-6b70e53395bb req-18e00e03-760e-4483-9957-b80772ac1dd3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406227 May 25 15:49:17.769375 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] Set router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:49:17.820965 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Calling delete_port for 7de68007-656f-4ebe-b48c-f94f0b3d44e1 owned by network:router_gateway {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:17.882359 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:49:17Z', 'revision_number': 6, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:17.886350 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8a77e84-552b-4760-83d5-0dfafc506505 None None] The sync data for ids ['033b53ca-9c17-4a0e-bdce-e24dc83318d6'] in dv-cinder-791239-3-iscsi is: [{'id': '033b53ca-9c17-4a0e-bdce-e24dc83318d6', 'name': 'tempest-AttachVolumeShelveTestJSON-689648399-router', 'tenant_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:39:53Z', 'updated_at': '2021-05-25T15:49:17Z', 'revision_number': 6, 'project_id': 'c00f6cd8c3154d2f835d5f59da9cc7e3', 'gw_port_host': None}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:49:17.963244 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:17.966676 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:18.009809 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Pushing event deleted for resources: {'Port': ['ID=7de68007-656f-4ebe-b48c-f94f0b3d44e1,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:18.012921 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:18.227766 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.402933 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.405331 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.428090 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.428619 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 033b53ca-9c17-4a0e-bdce-e24dc83318d6 {{(pid=98463) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:49:18.441182 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Notify callbacks [] for router, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.442281 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] 10.222.0.36 "DELETE /v2.0/routers/033b53ca-9c17-4a0e-bdce-e24dc83318d6 HTTP/1.1" status: 204 len: 168 time: 1.3370018 May 25 15:49:18.445013 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49432) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:18.506118 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Deleting subnet 2ce66291-0ef8-4b15-9e67-ba32027661fc {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:49:18.508976 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.557910 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.633754 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.942157 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:18.946717 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:18.983590 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2ce66291-0ef8-4b15-9e67-ba32027661fc,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:18.986314 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:18.994125 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a req-2bd1cc83-2ea5-4703-b9dc-90415e809bdd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:18.995739 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a req-2bd1cc83-2ea5-4703-b9dc-90415e809bdd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.1529548 May 25 15:49:18.998250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.004243 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16ece047-ce31-4502-9571-507c50d984f5 None None] Network 76bea034-0890-4bf6-b793-280aaec1a32c requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:49:19.018591 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c031996d-a818-45bf-8737-767f30fe10e7 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/2ce66291-0ef8-4b15-9e67-ba32027661fc HTTP/1.1" status: 204 len: 168 time: 0.5725708 May 25 15:49:19.023757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49438) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:19.046188 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9b808614-ceb2-4ad4-a88d-9eecbbcd524a req-b7a94189-d595-4b0b-8334-3fe531f1ffc6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440075 May 25 15:49:19.129992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.207559 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Deleting port 71d9316f-ff03-4b95-bed2-2b2b160077db {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:19.208051 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.266501 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] DHCP port deletion for 76bea034-0890-4bf6-b793-280aaec1a32c request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:49:19.309464 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] For port 71d9316f-ff03-4b95-bed2-2b2b160077db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=71d9316f-ff03-4b95-bed2-2b2b160077db,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:19.309740 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.334036 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Deleting port 71d9316f-ff03-4b95-bed2-2b2b160077db {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:49:19.334427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.444710 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Calling delete_port for 71d9316f-ff03-4b95-bed2-2b2b160077db owned by network:dhcp {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:19.447950 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] For port 71d9316f-ff03-4b95-bed2-2b2b160077db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=71d9316f-ff03-4b95-bed2-2b2b160077db,segment=NetworkSegment(8a902213-8048-4a9b-bc50-c79c837b967d),segment_id=8a902213-8048-4a9b-bc50-c79c837b967d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:19.448468 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.493586 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.499910 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6f8eef91-5245-4c8e-a49a-ed79e643e4af tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.523770 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e92dc1c3-6a99-4b16-85a6-e348d26267f4 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:49:19.543682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Pushing event deleted for resources: {'Port': ['ID=71d9316f-ff03-4b95-bed2-2b2b160077db,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:19.547338 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.548816 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] No DVR routers for this DVR port 71d9316f-ff03-4b95-bed2-2b2b160077db on host dv-cinder-791239-3-iscsi {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:49:19.621114 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Calling delete_port for 71d9316f-ff03-4b95-bed2-2b2b160077db owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:49:19.624653 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: e92dc1c3-6a99-4b16-85a6-e348d26267f4 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:49:19.625131 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device e92dc1c3-6a99-4b16-85a6-e348d26267f4 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:49:19.625657 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 7de68007-656f-4ebe-b48c-f94f0b3d44e1 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:49:19.664063 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 7de68007-656f-4ebe-b48c-f94f0b3d44e1 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:49:19.664420 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 7de68007-656f-4ebe-b48c-f94f0b3d44e1 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:49:19.664850 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 71d9316f-ff03-4b95-bed2-2b2b160077db no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:49:19.701093 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 71d9316f-ff03-4b95-bed2-2b2b160077db {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:49:19.701711 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 71d9316f-ff03-4b95-bed2-2b2b160077db not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:49:19.741945 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.745804 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.771142 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.788507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['76bea034-0890-4bf6-b793-280aaec1a32c']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:19.791939 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Pushing event deleted for resources: {'Port': ['ID=71d9316f-ff03-4b95-bed2-2b2b160077db,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:19.796069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.798238 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] No DVR routers for this DVR port 71d9316f-ff03-4b95-bed2-2b2b160077db on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:49:19.804005 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8a902213-8048-4a9b-bc50-c79c837b967d') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:19.804313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8a902213-8048-4a9b-bc50-c79c837b967d') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:19.818336 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.837787 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.844177 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Releasing vlan 389 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:49:19.844563 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:49:19.858270 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:49:19.938734 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.944328 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:19.948166 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:19.973577 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Pushing event deleted for resources: {'Network': ['ID=76bea034-0890-4bf6-b793-280aaec1a32c,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:19.976428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:19.979914 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] 10.222.0.36 "DELETE /v2.0/networks/76bea034-0890-4bf6-b793-280aaec1a32c HTTP/1.1" status: 204 len: 168 time: 0.9570243 May 25 15:49:20.094730 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49458) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:20.141991 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5bb27c82-ca7c-4e80-9885-2faf4e42925e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c00f6cd8c3154d2f835d5f59da9cc7e3&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0460315 May 25 15:49:20.144322 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49462) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:20.204576 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:20.229713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:20.282184 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:20.285947 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cbfce2c0-2e0c-4e8a-8175-f9bfc2d4ea75 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:20.300316 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6dd46eab-149a-48fb-a373-ddf68bb4aeb9,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:20.304092 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:20.307212 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:20.308348 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2545c1b0-4b42-4718-9762-f31ec760869d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/6dd46eab-149a-48fb-a373-ddf68bb4aeb9 HTTP/1.1" status: 204 len: 168 time: 0.1631339 May 25 15:49:20.671043 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:49:21.274935 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-86d2e3a0-e210-4ef0-9fde-6318d95da132 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:21.276425 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-86d2e3a0-e210-4ef0-9fde-6318d95da132 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1502049 May 25 15:49:21.291798 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9faee10e-daa1-4116-808a-300fde58dae1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/quotas/6e1f97f6101d466a9c224075352387d8 HTTP/1.1" status: 200 len: 375 time: 0.0096321 May 25 15:49:21.375922 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-4bff9f4a-e2f9-46b6-a81e-5076a5cd2864 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0782847 May 25 15:49:21.509215 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d79acd79-8e44-4b55-9600-68a18b86cc49 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266930 May 25 15:49:21.641058 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-0a49e2e1-3077-4f0f-92b7-37d8b22aaa57 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258097 May 25 15:49:21.828411 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-faaeb25b-544e-4c45-9846-60577941374b req-0cd5d489-d85f-4a51-ac38-5998dd27bd16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 210 time: 0.0512073 May 25 15:49:22.347140 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49552) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:22.470734 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.484621 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:22.488366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Usage tracker for resource:security_group_rule and tenant:cc27a6dea0ca460582eaf38b4f3a3adb is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:22.491100 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:22.497177 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:22.584282 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.588805 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.597022 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a4008449-5760-48dd-b828-6490146aeff8 tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:22.636267 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=cc27a6dea0ca460582eaf38b4f3a3adb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2880766 May 25 15:49:22.637954 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4364dd1-beb3-423e-8bcb-8c9d4631eafd,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:22.638912 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49558) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:22.641446 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:22.697707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.722156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.777724 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.781419 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d0a74aaf-2485-4c8c-979d-8236502d14c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:22.792290 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4364dd1-beb3-423e-8bcb-8c9d4631eafd,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:22.795137 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:22.811318 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:22.811318 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/e4364dd1-beb3-423e-8bcb-8c9d4631eafd HTTP/1.1" status: 204 len: 168 time: 0.1701469 May 25 15:49:23.014783 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-f1c8d888-646c-4e81-b45a-b5de70e55087 req-a848db05-d874-4055-a897-9e9ab5d69bcb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 210 time: 0.0631502 May 25 15:49:23.073639 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-6baf788a-35f6-4f78-8144-3b7371ce3a2e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:23.075626 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-6baf788a-35f6-4f78-8144-3b7371ce3a2e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1950667 May 25 15:49:23.096253 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Request body: {'port': {'device_id': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'admin_state_up': True, 'tenant_id': '6e1f97f6101d466a9c224075352387d8'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:23.136368 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49570) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:23.157862 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.172455 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:23.176354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Usage tracker for resource:security_group_rule and tenant:a22234bd4ad048d2bc1b6dc5e05b0db5 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:23.179230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:23.184932 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:23.238311 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:23.248174 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:23.265988 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.269706 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.273444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:23.276915 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.277831 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4ac2a6f8-095f-4d3f-bf25-fb6177e3dc96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:23.317824 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=a22234bd4ad048d2bc1b6dc5e05b0db5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1803284 May 25 15:49:23.318779 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7541ec5-ea1a-4916-bdbd-467f4e75c4b7,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:23.321062 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49576) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:23.323654 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:23.383728 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.410941 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.444289 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Allocated IP 172.20.0.9 (247feda9-7b6d-4c87-abaf-0b9c5d89f2d3/cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93/62e410a2-9c20-453a-864a-5ef7c5d2a2fd) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:49:23.462454 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.467827 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-cf486e0f-24e5-4794-a356-c435f584541a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:23.479431 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a7541ec5-ea1a-4916-bdbd-467f4e75c4b7,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:23.482274 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:23.492309 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.493340 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/a7541ec5-ea1a-4916-bdbd-467f4e75c4b7 HTTP/1.1" status: 204 len: 168 time: 0.1714010 May 25 15:49:23.649653 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.679961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.686681 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:23.695930 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e', '6fd10c0b-7953-4682-8b93-6b38d31fbca5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:23.864933 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:49:23.866075 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:23.870001 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:49:23.914869 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event updated for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:23.919718 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:23.949863 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:23.950561 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:23.975277 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9d89e331-048e-4537-84e6-510333f79d9f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8835292 May 25 15:49:23.991417 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Request body: {'port': {'device_id': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:24.107501 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.219732 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40abd678-d747-482d-a5ad-5b5109a8f168 req-56882ca5-ba4e-4efc-9810-929954cc8d48 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:24.221244 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-40abd678-d747-482d-a5ad-5b5109a8f168 req-56882ca5-ba4e-4efc-9810-929954cc8d48 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 931 time: 0.0874052 May 25 15:49:24.271294 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-40abd678-d747-482d-a5ad-5b5109a8f168 req-466616f8-de6c-4ccd-b247-2561af7bceed tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438726 May 25 15:49:24.456760 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 62e410a2-9c20-453a-864a-5ef7c5d2a2fd {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:24.463954 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.478201 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Transition to ACTIVE for port object 62e410a2-9c20-453a-864a-5ef7c5d2a2fd will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:49:24.481465 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.486030 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f35d4bd7-a766-40db-8ad5-197c41b1af79 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:24.644177 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Pushing event updated for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:24.651007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:24.715628 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Attempting to bind port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:49:24.715993 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Attempting to bind port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:49:24.716316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Attempting to bind port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:24.720942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:49:24.721264 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Attempting to bind port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:24.726246 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 49, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:49:24.726580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Checking segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:24.726959 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Bound using segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:49:24.727385 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Bound port: 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:49:24.727730 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.823150 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:49:24.826393 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:49:24.830956 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.835695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:24.891656 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:24.892290 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:24.893673 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] 10.222.0.70 "PUT /v2.0/ports/62e410a2-9c20-453a-864a-5ef7c5d2a2fd HTTP/1.1" status: 200 len: 1093 time: 0.9071517 May 25 15:49:24.894159 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:24.920357 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Pushing event updated for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:24.929748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:24.985131 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', 'status': 'completed', 'code': 200} May 25 15:49:25.020432 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-8ab99fed-49ea-4509-8b58-3b1d3941d0ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:25.021934 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-8ab99fed-49ea-4509-8b58-3b1d3941d0ec service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 1096 time: 0.0793157 May 25 15:49:25.097055 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-9f10a1cb-febf-477e-8fa2-f3ef5b3dcf64 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd HTTP/1.1" status: 200 len: 217 time: 0.0605915 May 25 15:49:25.173115 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-07433784-a77e-4df0-991a-e888736d654e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:25.174570 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-07433784-a77e-4df0-991a-e888736d654e service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0610683 May 25 15:49:25.227703 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-0f8b11c4-0f13-42e8-b93e-5048f24e1ea0 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0404291 May 25 15:49:25.371359 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-3ae5df0f-82df-4848-87c1-e972532db868 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1318815 May 25 15:49:25.473399 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 req-0c2de836-7eea-4524-8a48-89bfda3cdc5a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:25.475432 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 req-0c2de836-7eea-4524-8a48-89bfda3cdc5a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 943 time: 0.0904536 May 25 15:49:25.521941 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-86500af4-4b53-4b32-bba1-11ba5ef20cd1 req-d4b33ea3-4934-409a-a6f3-795aa753175a service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1378982 May 25 15:49:25.531962 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-83e6512b-3d7b-4af3-a38e-0e74a74dcb23 req-c3035884-31ea-462b-b38b-e69c7548f009 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455985 May 25 15:49:25.749448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-596515d8-2049-4ff5-81c2-324d2ddf8187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:25.750923 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-596515d8-2049-4ff5-81c2-324d2ddf8187 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 1096 time: 0.1591387 May 25 15:49:25.888852 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-c18c2da3-135b-4211-a465-22531eae8191 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:25.890335 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-c18c2da3-135b-4211-a465-22531eae8191 service neutron] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 916 time: 0.1257057 May 25 15:49:25.966154 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-b5c52214-b9b2-4daf-9ecf-8947c268115b service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd HTTP/1.1" status: 200 len: 217 time: 0.0650508 May 25 15:49:26.035302 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-6470d96b-350e-46d6-a250-8f254f5d8217 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:26.036631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-6470d96b-350e-46d6-a250-8f254f5d8217 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0603249 May 25 15:49:26.085216 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-29441bc4-e6de-4017-b1b0-2478072a502d service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0400345 May 25 15:49:26.214707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-9eb7d785-dcb9-42c2-aa3c-d298025031f2 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1210313 May 25 15:49:26.345849 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a932e3cf-9cd7-4907-acf5-949e31f141de req-97058c38-7594-4ab1-bee0-de084e9462fd service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226385 May 25 15:49:26.745082 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7d6667-dc38-492c-b6f7-0bd756314a89 req-7093d3c1-4ac5-4386-b539-1e13fc98c1fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:26.745775 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-1b7d6667-dc38-492c-b6f7-0bd756314a89 req-7093d3c1-4ac5-4386-b539-1e13fc98c1fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:49:26.763930 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-1b7d6667-dc38-492c-b6f7-0bd756314a89 req-7093d3c1-4ac5-4386-b539-1e13fc98c1fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:49:26.765131 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b7d6667-dc38-492c-b6f7-0bd756314a89 req-7093d3c1-4ac5-4386-b539-1e13fc98c1fb tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 943 time: 0.1146820 May 25 15:49:26.817729 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b7d6667-dc38-492c-b6f7-0bd756314a89 req-0f4c701c-1c7d-4d65-83f1-0f6359e81ee9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449157 May 25 15:49:28.013273 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 req-b3c71abe-981d-4422-ae04-9bac41c261c9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:28.014720 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 req-b3c71abe-981d-4422-ae04-9bac41c261c9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 943 time: 0.0857158 May 25 15:49:28.154195 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c5ae2c3c-64cb-4ae6-8fa3-ce570d59cac0 req-29101840-d030-44aa-b1d2-5e0ebeacced0 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1335063 May 25 15:49:29.336474 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7534271b-94e5-4cb7-998a-603180dd9928 req-ebc23568-3a43-45d8-82b7-ee00e1e86850 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:29.337850 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7534271b-94e5-4cb7-998a-603180dd9928 req-ebc23568-3a43-45d8-82b7-ee00e1e86850 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 943 time: 0.0810063 May 25 15:49:29.384336 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-7534271b-94e5-4cb7-998a-603180dd9928 req-a5711ec4-9c97-464f-a4b2-76c05d2c16be tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404670 May 25 15:49:29.528191 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62e410a2-9c20-453a-864a-5ef7c5d2a2fd details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:49:29.658071 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:29.671007 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'port_id': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', 'mac_address': 'fa:16:3e:1f:32:98', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:49:29.727322 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:29.744017 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 62e410a2-9c20-453a-864a-5ef7c5d2a2fd {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:29.758754 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:29.763766 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:29.764805 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-b5af27aa-1100-4bff-a740-7be07cbd1723 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:29.829575 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:29.837786 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.838134 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.838474 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.838809 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.839145 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.839468 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.839794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.840142 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.840467 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.840792 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.841113 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.841432 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:29.845812 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:29.972447 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-90868b7a-0cca-47eb-9ad9-0f6bc1f919d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:30.564427 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d19d009-a0cb-446a-b46d-0743b497e7b3 req-2e38642c-d56c-4dc9-b36b-872d65ef5fb3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:30.565844 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1d19d009-a0cb-446a-b46d-0743b497e7b3 req-2e38642c-d56c-4dc9-b36b-872d65ef5fb3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 944 time: 0.0786557 May 25 15:49:30.613157 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-1d19d009-a0cb-446a-b46d-0743b497e7b3 req-8e267d01-2c47-4a37-80bc-91d6657282ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417755 May 25 15:49:31.188415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['62e410a2-9c20-453a-864a-5ef7c5d2a2fd'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:31.801805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 req-27da337c-4b97-45d9-8481-0866992d4ab8 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:31.803264 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 req-27da337c-4b97-45d9-8481-0866992d4ab8 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 944 time: 0.0841033 May 25 15:49:31.849360 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-dd6fa40e-980b-44e9-8f23-58e3b9724c90 req-da1d154d-8bf1-4cde-b15f-6a9d6932ddff tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398149 May 25 15:49:32.435041 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49696) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:32.555253 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.570717 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:32.574700 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Usage tracker for resource:security_group_rule and tenant:56d44392f8f5486fa81c49413a80d3e5 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:32.577578 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:32.583286 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:32.649649 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.669641 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.674787 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.689303 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:32.712975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b2090a61-2e3a-4bec-ab3b-6fe3afeb2f45 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.734761 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=56d44392f8f5486fa81c49413a80d3e5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2956598 May 25 15:49:32.734761 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f15a03c-3aea-4477-8663-84ca9ad3955f,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:32.735230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49706) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:32.741275 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.741652 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.742002 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.742360 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.742713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.743066 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.743414 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.743762 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.744136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.744479 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.744822 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.745169 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:32.749011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:32.749341 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62e410a2-9c20-453a-864a-5ef7c5d2a2fd up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:49:32.819422 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:49:32.823596 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.825545 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:49:32.826269 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.855053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.913124 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.918890 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2151a45a-9822-4832-bf4c-59fe08f84640 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:32.930507 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f15a03c-3aea-4477-8663-84ca9ad3955f,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:32.933124 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:32.940542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.942585 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ce985204-4752-4fc2-abc9-3b902a76f222 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/8f15a03c-3aea-4477-8663-84ca9ad3955f HTTP/1.1" status: 204 len: 168 time: 0.2061696 May 25 15:49:32.961539 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:32.991838 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:33.005345 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:33.010925 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.016733 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-415a8b99-ee92-4110-bf66-36c6c7cd1230 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:33.052724 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20fa986-8ebc-4bb2-82b6-c9581deac933 req-af740dba-2733-4f36-8db7-3df6e9801265 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:33.054233 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f20fa986-8ebc-4bb2-82b6-c9581deac933 req-af740dba-2733-4f36-8db7-3df6e9801265 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 944 time: 0.0915468 May 25 15:49:33.089809 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', 'code': 200} May 25 15:49:33.103301 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f20fa986-8ebc-4bb2-82b6-c9581deac933 req-2e12ea66-2696-4ed2-9f7b-5e1be2084e56 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419939 May 25 15:49:33.103470 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:33.106464 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:33.263640 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49718) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:33.314430 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.339625 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:33.347175 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Usage tracker for resource:security_group_rule and tenant:f7e136eeb25043df9996ed9909b43f39 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:33.351771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:33.359554 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:33.389672 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-661a91e6-6eeb-4624-b675-989cbd2779f6 req-13a1762a-f1e1-4d2f-ba0c-0519579bc19c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:33.392147 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-661a91e6-6eeb-4624-b675-989cbd2779f6 req-13a1762a-f1e1-4d2f-ba0c-0519579bc19c service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 1098 time: 0.1135666 May 25 15:49:33.456843 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-661a91e6-6eeb-4624-b675-989cbd2779f6 req-7af9ef0d-c02d-4639-9f42-721750003c1c service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533280 May 25 15:49:33.468901 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.494217 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.497913 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.505925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b40e6b5f-7c2a-4b1c-bc1a-a7a09fd719fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:33.545947 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=f7e136eeb25043df9996ed9909b43f39&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2811217 May 25 15:49:33.547682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14a3d8ba-01a3-4f6d-9350-86e84630920e,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:33.548789 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49722) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:33.550599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:33.606516 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.631981 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.684018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.688228 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8ee3968a-ac6c-484e-be04-63548a8abbe8 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:33.699035 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14a3d8ba-01a3-4f6d-9350-86e84630920e,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:33.702993 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:33.706176 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:33.707279 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-00f14a89-71b0-4f30-969c-154c71120f7a admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/14a3d8ba-01a3-4f6d-9350-86e84630920e HTTP/1.1" status: 204 len: 168 time: 0.1575317 May 25 15:49:34.293454 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7b4be0-03ec-4baf-a946-ace5d467d00d req-dd48404e-a02e-44a7-a2c8-97d5278af00b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:34.295022 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb7b4be0-03ec-4baf-a946-ace5d467d00d req-dd48404e-a02e-44a7-a2c8-97d5278af00b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.0842681 May 25 15:49:34.340368 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-fb7b4be0-03ec-4baf-a946-ace5d467d00d req-5cc9261e-9cd0-438b-996a-94259eb11c85 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387828 May 25 15:49:35.188363 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:35.540245 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d req-9474db13-20ed-4d75-9b5d-7d400a864c4f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:35.541977 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d req-9474db13-20ed-4d75-9b5d-7d400a864c4f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.0882881 May 25 15:49:35.590315 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bc5e3e63-4bfd-45d6-83e2-48131a88dc9d req-796bcb2f-0276-4238-8788-b733e2363c78 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416908 May 25 15:49:35.734865 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49792) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:35.857351 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:35.873356 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:35.877850 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Usage tracker for resource:security_group_rule and tenant:9e531da9563f4283aaae1a43a651e28a is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:35.882178 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:35.888278 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:35.986228 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:35.992989 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.001869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4de5cff7-14da-455f-87a7-13b533824637 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:36.050035 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=9e531da9563f4283aaae1a43a651e28a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3140872 May 25 15:49:36.050998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2193297-9fa3-41b1-9687-210d42ce3a1e,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:36.052727 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49804) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:36.054011 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c9baf531-750a-4f29-a5f5-2aae506fe686 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:36.129064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.157095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.210168 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.215102 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-89fcc7f5-25ae-417c-ae44-38b647c977e5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:36.229335 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2193297-9fa3-41b1-9687-210d42ce3a1e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:36.234420 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:36.242800 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.246272 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b72e315e-39f1-4812-b6cb-9ac2ded3aded admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f2193297-9fa3-41b1-9687-210d42ce3a1e HTTP/1.1" status: 204 len: 168 time: 0.1849434 May 25 15:49:36.449040 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d061a67e-3fee-4ff6-8982-214138924eb1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1147553235&fields=id&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 267 time: 0.0425329 May 25 15:49:36.534594 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49824) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:36.555736 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.570838 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:36.574593 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Usage tracker for resource:security_group_rule and tenant:1be9e04f0cfc43acbada43ba07523c6d is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:36.577980 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:36.583597 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:36.604452 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-6244d929-ed34-41c0-8667-b75126d8b26a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:36.605930 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-6244d929-ed34-41c0-8667-b75126d8b26a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.1492474 May 25 15:49:36.620959 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-e962836d-612e-4e9d-a7a5-d2d01911ba64 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/quotas/8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 375 time: 0.0092955 May 25 15:49:36.668262 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.671795 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.678943 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-11cf0c55-7d62-40cd-937f-90a8556e3037 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:36.715152 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-b91aa5af-06f4-4aed-be82-8c36f6a51f66 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0879364 May 25 15:49:36.720153 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=1be9e04f0cfc43acbada43ba07523c6d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1844454 May 25 15:49:36.721170 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f124630f-622f-49fe-99ad-f9334ebdc74a,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:36.722796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 49828) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:36.724267 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:36.960267 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:36.994008 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-dc233fd2-35de-4790-80c3-edfe835a5aee service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1774063 May 25 15:49:37.018838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:37.159312 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-ce04a751-51ea-4982-bc24-e11d397b1665 service neutron] 10.222.0.36 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1586735 May 25 15:49:37.163249 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:37.168318 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f0cf7980-78e9-4097-a6ee-384e65d793dc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:37.182175 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f124630f-622f-49fe-99ad-f9334ebdc74a,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:37.184866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:37.186159 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:37.190164 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b9139222-3667-4352-b569-698213534a54 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/f124630f-622f-49fe-99ad-f9334ebdc74a HTTP/1.1" status: 204 len: 168 time: 0.4662969 May 25 15:49:37.620038 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d60c4128-7362-41d6-b1db-672499cafa11 req-e56abe15-aff9-4744-96e6-60408a7f0f5b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 210 time: 0.0714390 May 25 15:49:38.053711 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49880) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:38.160133 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1740515467-network', 'tenant_id': 'c375986121c142cf92346a42e26695e6'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:38.164812 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:38.168675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Usage tracker for resource:network and tenant:c375986121c142cf92346a42e26695e6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:38.171644 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:38.178696 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:38.194968 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Made reservation on behalf of c375986121c142cf92346a42e26695e6 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:38.197384 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.210542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.224688 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:38.228609 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Usage tracker for resource:security_group_rule and tenant:c375986121c142cf92346a42e26695e6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:38.231398 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:38.237230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:38.323584 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.327246 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.331071 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c0a2a663-daf6-4a84-bded-c111e485bf84 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:38.357973 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 385} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:49:38.370792 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e0d7b0b0-7c30-4140-ab3f-d71aa0fd73cd,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:38.376260 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.376601 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Added segment 9892984c-772c-463e-ae7a-d371f24f37ea of type vlan for network 67cb9c19-71a2-40aa-9c97-b6a69180cb24 May 25 15:49:38.384670 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.385044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.385416 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.385774 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.386134 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.386492 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.386844 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.387194 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.387546 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.387921 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.388270 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.388616 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:49:38.392800 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:38.415818 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.445758 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.447122 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:38.447704 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.452482 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-02a90161-ae93-44a7-93b1-369c55dfe7f3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:38.554335 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Pushing event updated for resources: {'Network': ['ID=67cb9c19-71a2-40aa-9c97-b6a69180cb24,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:38.558790 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:38.564671 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5098608 May 25 15:49:38.566006 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 67cb9c19-71a2-40aa-9c97-b6a69180cb24 details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:49:38.567887 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49886) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:38.573530 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Request body: {'subnet': {'network_id': '67cb9c19-71a2-40aa-9c97-b6a69180cb24', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1740515467-subnet', 'tenant_id': 'c375986121c142cf92346a42e26695e6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:38.578460 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:38.582822 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Usage tracker for resource:subnet and tenant:c375986121c142cf92346a42e26695e6 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:38.585678 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:38.591353 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:38.603422 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Made reservation on behalf of c375986121c142cf92346a42e26695e6 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:38.606466 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:38.811676 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-9e13e90d-9c10-4867-b7a8-d5794ea3cb66 req-22c11a90-f317-479a-85ff-867e0a2e9c58 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 210 time: 0.0517173 May 25 15:49:38.998694 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-a3cdd552-66fd-414a-b6b2-dad37a37b2c0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:39.000733 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-a3cdd552-66fd-414a-b6b2-dad37a37b2c0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 811 time: 0.1550908 May 25 15:49:39.060707 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-baec9755-d4c6-456e-ac27-1a04ef931154 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=8dff1003ceba47f6a75b4c3901343b7b HTTP/1.1" status: 200 len: 380 time: 0.0414433 May 25 15:49:39.067444 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.072014 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:39.074159 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'port': {'device_id': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'admin_state_up': True, 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'security_groups': ['1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb']}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:39.144437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ea9f8f10-1713-40f3-bf0d-37210f1ec406,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:39.147361 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:39.155182 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Checking segment: {'id': '9892984c-772c-463e-ae7a-d371f24f37ea', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 385, 'network_id': '67cb9c19-71a2-40aa-9c97-b6a69180cb24'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:39.155570 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Network hostable DHCP agents. Network: 67cb9c19-71a2-40aa-9c97-b6a69180cb24, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:49:39.173474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Network 67cb9c19-71a2-40aa-9c97-b6a69180cb24 is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:49:39.185210 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 67cb9c19-71a2-40aa-9c97-b6a69180cb24) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:39.195581 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:39.196280 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.197366 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-613bf9d2-3f48-4bf2-be6c-087f74d6cb7b None None] Network 67cb9c19-71a2-40aa-9c97-b6a69180cb24 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:49:39.219352 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-00ed4afd-3c87-4cc4-b063-ec6c10cfb891 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6501110 May 25 15:49:39.220166 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:39.230502 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:39.240692 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Made reservation on behalf of 8dff1003ceba47f6a75b4c3901343b7b for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:39.244206 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.402500 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b7b2180-12ec-4268-8636-685c58d75872 None None] Network 67cb9c19-71a2-40aa-9c97-b6a69180cb24 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:49:39.418692 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.20.0.7 (d8a04926-b628-40fa-a53b-51df7783813d/693414b7-eaf3-4626-b7cd-b644e55f5f70/b62764e4-ba3e-4187-9554-db7555c582f2) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:49:39.623677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.642670 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Transition to ACTIVE for port object b62764e4-ba3e-4187-9554-db7555c582f2 will not be triggered until provisioned by entity DHCP. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:49:39.666957 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.672697 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-02aee258-2d02-4f47-a217-4816a9acba1d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:39.736399 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network d8a04926-b628-40fa-a53b-51df7783813d is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:49:39.739201 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:39.743056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:49:39.769183 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49908) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:39.775230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1544246948-network', 'tenant_id': '87e7763a9c514433b22c0abf4431c774'}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:39.780476 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:39.781802 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:39.785110 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Usage tracker for resource:network and tenant:87e7763a9c514433b22c0abf4431c774 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:39.786213 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:39.789605 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:39.797475 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:39.818960 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:39.819640 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.825875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Made reservation on behalf of 87e7763a9c514433b22c0abf4431c774 for: {'network': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:39.828512 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3734797'] for network, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.845286 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:39.851525 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7816131 May 25 15:49:39.863149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:39.868341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Request body: {'port': {'device_id': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:39.869198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Usage tracker for resource:security_group_rule and tenant:87e7763a9c514433b22c0abf4431c774 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:39.872632 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:39.880324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:39.996852 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.001302 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.005632 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b9f7d328-aad7-49fa-aa33-d71ccc5219ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:40.037093 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 366} {{(pid=98463) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 15:49:40.044907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-6d0ce28d-9f47-4689-9bf1-418e4aa36f36 None None] Provisioning for port b62764e4-ba3e-4187-9554-db7555c582f2 completed by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:49:40.045679 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.047100 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=09f642a5-9b66-42f9-8344-0ebfff107f38,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:40.050771 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:40.054029 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.054506 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.segments_db [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Added segment 6d61ba9f-9161-4af1-9496-a0f7b8ebee46 of type vlan for network 09519bd2-e90e-48d3-acf0-170fd34e172d May 25 15:49:40.055628 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-6d0ce28d-9f47-4689-9bf1-418e4aa36f36 None None] Provisioning complete for port b62764e4-ba3e-4187-9554-db7555c582f2 triggered by entity DHCP. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:49:40.056155 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6d0ce28d-9f47-4689-9bf1-418e4aa36f36 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.088977 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8752733825109'] for network, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.117932 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-6d0ce28d-9f47-4689-9bf1-418e4aa36f36 None None] Port b62764e4-ba3e-4187-9554-db7555c582f2 cannot update to ACTIVE because it is not bound. {{(pid=98464) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 15:49:40.123053 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445'] for network, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.125152 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:40.125739 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.130622 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:40.207389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a821d79f-4c00-4c1b-ac22-7f07f79925de req-2365cf90-e83a-48e1-b86f-b7b65f4ecea7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:40.208164 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-a821d79f-4c00-4c1b-ac22-7f07f79925de req-2365cf90-e83a-48e1-b86f-b7b65f4ecea7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:49:40.258891 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-a821d79f-4c00-4c1b-ac22-7f07f79925de req-2365cf90-e83a-48e1-b86f-b7b65f4ecea7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:49:40.260006 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a821d79f-4c00-4c1b-ac22-7f07f79925de req-2365cf90-e83a-48e1-b86f-b7b65f4ecea7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 931 time: 0.2676892 May 25 15:49:40.331920 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] 10.222.0.36 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5587947 May 25 15:49:40.331920 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Pushing event updated for resources: {'Network': ['ID=09519bd2-e90e-48d3-acf0-170fd34e172d,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:40.332245 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 49916) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:40.334670 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4352cf57-59ed-4a9d-83b2-60d1e3e325e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:40.338714 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.v2.base [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Request body: {'subnet': {'network_id': '09519bd2-e90e-48d3-acf0-170fd34e172d', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1544246948-subnet', 'tenant_id': '87e7763a9c514433b22c0abf4431c774', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=98463) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:40.341427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Network 09519bd2-e90e-48d3-acf0-170fd34e172d details requested by agent ovs-agent-dv-cinder-791239-3-iscsi with host dv-cinder-791239-3-iscsi {{(pid=98464) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 15:49:40.343699 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:40.347725 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Usage tracker for resource:subnet and tenant:87e7763a9c514433b22c0abf4431c774 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:49:40.350849 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:49:40.357378 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:40.369543 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Made reservation on behalf of 87e7763a9c514433b22c0abf4431c774 for: {'subnet': 1} {{(pid=98463) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:40.372367 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-10999121'] for subnet, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.497285 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a821d79f-4c00-4c1b-ac22-7f07f79925de req-526aec19-f592-4019-8371-88a35852bd19 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699339 May 25 15:49:40.595820 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b62764e4-ba3e-4187-9554-db7555c582f2 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:40.603325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.617970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Transition to ACTIVE for port object b62764e4-ba3e-4187-9554-db7555c582f2 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:49:40.621105 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.626048 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-436fbb69-ac02-4387-af00-da95ca08d6de tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:40.764788 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-1737132', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-10999111'] for subnet, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.768744 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:40.784720 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Pushing event updated for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:40.817704 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:40.855649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d2fd4444-ae91-4a70-8e60-4700b2139715,revision_number=0']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:40.859276 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:40.860304 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Checking segment: {'id': '6d61ba9f-9161-4af1-9496-a0f7b8ebee46', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '09519bd2-e90e-48d3-acf0-170fd34e172d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98463) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:40.860690 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Network hostable DHCP agents. Network: 09519bd2-e90e-48d3-acf0-170fd34e172d, hostable agents: ['21fb1f31-bb79-4717-9dea-d3af4ef56c68'], hosted agents: [] {{(pid=98463) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 15:49:40.864653 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Attempting to bind port b62764e4-ba3e-4187-9554-db7555c582f2 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:49:40.864992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Attempting to bind port b62764e4-ba3e-4187-9554-db7555c582f2 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:49:40.865316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Attempting to bind port b62764e4-ba3e-4187-9554-db7555c582f2 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:40.870117 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Port b62764e4-ba3e-4187-9554-db7555c582f2 on network d8a04926-b628-40fa-a53b-51df7783813d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:49:40.870383 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Attempting to bind port b62764e4-ba3e-4187-9554-db7555c582f2 on network d8a04926-b628-40fa-a53b-51df7783813d {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:40.876303 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 49, 13), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:49:40.876708 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Checking segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:40.877058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Bound using segment: {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:49:40.877561 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Bound port: b62764e4-ba3e-4187-9554-db7555c582f2, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bbec2705-fa86-48c1-842e-d80e8691ed54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 377, 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:49:40.877937 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.879368 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Network 09519bd2-e90e-48d3-acf0-170fd34e172d is scheduled to be hosted by DHCP agent 21fb1f31-bb79-4717-9dea-d3af4ef56c68 with binding_index 1 {{(pid=98463) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 15:49:40.888829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.base_scheduler [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-791239-3-iscsi, 09519bd2-e90e-48d3-acf0-170fd34e172d) {{(pid=98463) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:40.896884 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e7b6abb-7be0-4812-9787-1b44e0123ba2 None None] Network 09519bd2-e90e-48d3-acf0-170fd34e172d requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:49:40.900335 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:40.900928 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:40.927348 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-135e13ea-6fa2-4bf2-bb2d-850b0efae094 admin admin] 10.222.0.36 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5907416 May 25 15:49:40.991232 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:49:40.995963 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b62764e4-ba3e-4187-9554-db7555c582f2,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:49:41.004549 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:41.011085 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-3cfeca89-59b1-42da-a638-0bb9724675b7 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:41.086750 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.087617 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:41.089286 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] 10.222.0.70 "PUT /v2.0/ports/b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 200 len: 1093 time: 1.2264094 May 25 15:49:41.089878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:41.120680 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Pushing event updated for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:41.123699 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:41.127553 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f0ffb63-5f66-4292-9e36-c082110c05bd None None] Network 09519bd2-e90e-48d3-acf0-170fd34e172d requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:49:41.195103 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'status': 'completed', 'code': 200} May 25 15:49:41.239677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-bbfe6bcb-76c0-48d3-8657-7928ca90d7d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.242066 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-bbfe6bcb-76c0-48d3-8657-7928ca90d7d7 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1096 time: 0.0871139 May 25 15:49:41.334172 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-36889d6e-dee2-4437-9321-1f103efd0b53 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 200 len: 217 time: 0.0785272 May 25 15:49:41.400603 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-2b9d72b9-78ba-489f-88e1-df9d269dbb3d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.402072 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-2b9d72b9-78ba-489f-88e1-df9d269dbb3d service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0576410 May 25 15:49:41.489048 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-45eb66f4-bd3b-4a4b-99a6-51b5a58fce7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.490617 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-45eb66f4-bd3b-4a4b-99a6-51b5a58fce7a service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0795202 May 25 15:49:41.678481 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-fec4cd79-9649-4369-9d9b-e5304802ac08 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1776056 May 25 15:49:41.804927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 req-52e59290-bc7f-475b-93dd-7a5c42157c92 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.806326 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 req-52e59290-bc7f-475b-93dd-7a5c42157c92 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.1932197 May 25 15:49:41.860198 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9f63ddab-c544-4b32-80ba-7477543865d0 req-76471c02-a4c2-4902-bdb7-4e4c8389296c service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1734920 May 25 15:49:41.869956 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-af2c1957-c902-4fe8-bc8f-695d9e9b2614 req-bb044087-ea75-4464-9202-a535194048c9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555196 May 25 15:49:41.988078 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12979547-4714-4983-93eb-5ebcf76bab86 req-32d156ae-6152-48f7-8b7d-d640b7019559 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:41.989552 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-32d156ae-6152-48f7-8b7d-d640b7019559 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1096 time: 0.0744314 May 25 15:49:42.131072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12979547-4714-4983-93eb-5ebcf76bab86 req-1da07545-ed32-4ccd-b68e-f3f11828826d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.132554 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-1da07545-ed32-4ccd-b68e-f3f11828826d service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1332517 May 25 15:49:42.205002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-6708c27a-58b3-4c87-8eab-caeb0cab000a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 200 len: 217 time: 0.0608931 May 25 15:49:42.368357 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12979547-4714-4983-93eb-5ebcf76bab86 req-ed98b357-ed7c-48a9-afe9-b7d07672d575 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.369706 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-ed98b357-ed7c-48a9-afe9-b7d07672d575 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.1524034 May 25 15:49:42.452444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12979547-4714-4983-93eb-5ebcf76bab86 req-98e446cf-eb94-40f3-931c-80e3162ac551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:42.453927 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-98e446cf-eb94-40f3-931c-80e3162ac551 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0731273 May 25 15:49:42.593626 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-819cb3d9-0076-499f-a770-418ea45eb18f service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1230900 May 25 15:49:42.683175 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:42.732165 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12979547-4714-4983-93eb-5ebcf76bab86 req-eddea24d-3188-43f7-92df-2e57451a61e3 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1259215 May 25 15:49:43.065261 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f99a666-e8ee-4132-b34d-69875943e6fd req-55119b7d-2a1f-47bf-9b71-85d957e013c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:43.066732 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6f99a666-e8ee-4132-b34d-69875943e6fd req-55119b7d-2a1f-47bf-9b71-85d957e013c5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0853450 May 25 15:49:43.111485 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6f99a666-e8ee-4132-b34d-69875943e6fd req-42d22f50-0ad6-4e61-823c-a6010d8e2821 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0389285 May 25 15:49:44.294909 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aae4af5f-2c11-46ae-8654-b88ed3eac695 req-492753ee-f9bf-4cf9-9243-c43aa98c9f4e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:44.296748 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aae4af5f-2c11-46ae-8654-b88ed3eac695 req-492753ee-f9bf-4cf9-9243-c43aa98c9f4e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0811071 May 25 15:49:44.354520 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-aae4af5f-2c11-46ae-8654-b88ed3eac695 req-73b0727e-d03b-4eba-b888-292289b3de24 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0519986 May 25 15:49:45.553867 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 req-2d1efaf6-1bb7-40d5-9b2c-c76cde7ee0db tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:45.555356 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 req-2d1efaf6-1bb7-40d5-9b2c-c76cde7ee0db tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0818493 May 25 15:49:45.601827 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-4b3ce5d7-ee03-4c0c-8a34-470fe9ef7fc0 req-6836eb73-4262-4ae8-918f-5e450bffc090 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407195 May 25 15:49:46.796540 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09048c42-f0c6-471c-a0db-bf5518806597 req-fcff6ca2-1765-44e0-912b-17011dbfb63b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:46.797974 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-09048c42-f0c6-471c-a0db-bf5518806597 req-fcff6ca2-1765-44e0-912b-17011dbfb63b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0836270 May 25 15:49:46.841525 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-09048c42-f0c6-471c-a0db-bf5518806597 req-e9eb0fff-5820-4a15-aac5-c33b4b678217 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379105 May 25 15:49:48.033755 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 req-7e59a09d-a9ab-46bd-aab7-9b8bd3736f97 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:48.035498 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 req-7e59a09d-a9ab-46bd-aab7-9b8bd3736f97 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0869088 May 25 15:49:48.078650 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-696c0ef9-bf9e-4755-91dc-e8e1d0a52578 req-e93d4874-91cc-4a19-9b93-69c506e644b1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375929 May 25 15:49:48.713355 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-8b96954e-7cea-4f93-8351-97a0194da4b9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:48.714778 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-8b96954e-7cea-4f93-8351-97a0194da4b9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.1417217 May 25 15:49:48.728793 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-e1e4626d-a86a-4582-b7b4-65e1ac29611d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/quotas/6e1f97f6101d466a9c224075352387d8 HTTP/1.1" status: 200 len: 375 time: 0.0085974 May 25 15:49:48.822413 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-a95bc977-ee9c-4d12-9f42-addf08bd151c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0889165 May 25 15:49:48.955839 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-83342a36-67c0-4af0-8586-ac2f27d1bef1 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267738 May 25 15:49:49.089405 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-392a5a0a-cfad-4ed2-8159-af64ea952d14 service neutron] 10.222.0.36 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269042 May 25 15:49:49.288289 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9bc1e738-40e7-4f61-b0da-a6b0a623fe62 req-8105e456-407d-49be-b91e-d1b8e41eb098 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.0564959 May 25 15:49:49.466268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-486a7aca-9b45-44bb-9c79-e50e18420c56 req-3f2cc471-0792-4e4e-b83f-171c478980b9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:49.469046 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-486a7aca-9b45-44bb-9c79-e50e18420c56 req-3f2cc471-0792-4e4e-b83f-171c478980b9 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.2834623 May 25 15:49:49.520030 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-486a7aca-9b45-44bb-9c79-e50e18420c56 req-4cc3607b-a96a-449f-90c9-fe6be9318df5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460100 May 25 15:49:50.584234 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f583d855-30c5-42c9-b196-5d55e3e6c132 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:50.586579 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f583d855-30c5-42c9-b196-5d55e3e6c132 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 815 time: 0.2093453 May 25 15:49:50.596406 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-be534aaf-d3e3-42fa-b897-5d2104108c77 req-66464b9f-5e53-4c39-a2f9-810dfb594339 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.1879086 May 25 15:49:50.607780 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Request body: {'port': {'device_id': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'admin_state_up': True, 'tenant_id': '6e1f97f6101d466a9c224075352387d8'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:50.745441 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca req-22078104-b81c-4412-8b69-56f3648556d7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:50.747486 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca req-22078104-b81c-4412-8b69-56f3648556d7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0986993 May 25 15:49:50.775996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:49:50.790670 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:49:50.802270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Made reservation on behalf of 6e1f97f6101d466a9c224075352387d8 for: {'port': 1} {{(pid=98462) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 15:49:50.803189 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-216ea2f6-ac7d-46c4-85e5-32a56b0e11ca req-630d6235-6fce-42d0-83d3-f80afe8c6456 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479624 May 25 15:49:50.806374 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:50.973515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Allocated IP 172.20.0.10 (247feda9-7b6d-4c87-abaf-0b9c5d89f2d3/cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93/1edf8be0-5889-4766-ae81-82de066f9110) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:49:51.263235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:51.293047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:51.298460 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-37356275-ce17-47e8-838e-b64476de6e42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:51.312074 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e', '6fd10c0b-7953-4682-8b93-6b38d31fbca5', '62e410a2-9c20-453a-864a-5ef7c5d2a2fd'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:51.360513 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:49:51.363559 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:49:51.367188 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:49:51.404890 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event updated for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:51.409390 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:51.435758 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:51.436385 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:51.461995 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8587174 May 25 15:49:51.481461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Request body: {'port': {'device_id': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79123'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:49:51.590289 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:51.902683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5aa01ac-b875-485c-a360-bc3ca058662f req-a2febe66-9eb7-40f1-9218-1cc37cb5041d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:51.904000 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-a5aa01ac-b875-485c-a360-bc3ca058662f req-a2febe66-9eb7-40f1-9218-1cc37cb5041d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:49:51.947087 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-a5aa01ac-b875-485c-a360-bc3ca058662f req-a2febe66-9eb7-40f1-9218-1cc37cb5041d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:49:51.948274 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5aa01ac-b875-485c-a360-bc3ca058662f req-a2febe66-9eb7-40f1-9218-1cc37cb5041d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 932 time: 0.2384350 May 25 15:49:51.999295 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b98669-d719-422a-bd34-94c708304dac req-a7d89bd2-8b30-4cd5-834c-be59cff68587 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:52.001346 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-42b98669-d719-422a-bd34-94c708304dac req-a7d89bd2-8b30-4cd5-834c-be59cff68587 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0900040 May 25 15:49:52.044681 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-42b98669-d719-422a-bd34-94c708304dac req-4bde9f1b-823e-4b92-8ed3-208953bb6d7d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378411 May 25 15:49:52.054315 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5aa01ac-b875-485c-a360-bc3ca058662f req-c48e0ca4-7d51-42d1-b65e-a1365ff359ea tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942864 May 25 15:49:52.062855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1edf8be0-5889-4766-ae81-82de066f9110 {{(pid=98462) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:52.070824 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:52.086063 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.provisioning_blocks [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Transition to ACTIVE for port object 1edf8be0-5889-4766-ae81-82de066f9110 will not be triggered until provisioned by entity L2. {{(pid=98462) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 15:49:52.090211 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:52.094748 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-aef548b0-2ff0-420e-9a6c-4bab7115a303 tempest-VolumesActionsTest-1979971151 tempest-VolumesActionsTest-1979971151-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:52.258885 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Pushing event updated for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:52.264951 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:52.332184 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Attempting to bind port 1edf8be0-5889-4766-ae81-82de066f9110 on host hv-cinder-79123 for vnic_type normal with profile {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 15:49:52.332530 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Attempting to bind port 1edf8be0-5889-4766-ae81-82de066f9110 by drivers openvswitch,hyperv on host hv-cinder-79123 at level 0 using segments [{'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 15:49:52.332863 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Attempting to bind port 1edf8be0-5889-4766-ae81-82de066f9110 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:52.337695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Port 1edf8be0-5889-4766-ae81-82de066f9110 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79123 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 15:49:52.338019 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Attempting to bind port 1edf8be0-5889-4766-ae81-82de066f9110 on network 247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 15:49:52.343656 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Checking agent: {'id': 'c7a51cf1-4379-49e9-9417-aa0f20149974', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79123', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'started_at': datetime.datetime(2021, 5, 25, 15, 38, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 15, 49, 43), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 15:49:52.344037 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Checking segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=98462) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 15:49:52.344437 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Bound using segment: {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'} {{(pid=98462) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 15:49:52.344892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.managers [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Bound port: 1edf8be0-5889-4766-ae81-82de066f9110, host: hv-cinder-79123, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2cf525b3-654f-4720-8254-63dec3a85366', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 350, 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3'}}] {{(pid=98462) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 15:49:52.345370 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:52.440705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, cleared binding levels {{(pid=98462) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 15:49:52.443637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=1edf8be0-5889-4766-ae81-82de066f9110,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 15:49:52.447757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:52.452141 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-446928eb-6bdb-4a41-a3fc-e576610cbf19 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:52.506324 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:52.507006 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:52.508475 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] 10.222.0.70 "PUT /v2.0/ports/1edf8be0-5889-4766-ae81-82de066f9110 HTTP/1.1" status: 200 len: 1094 time: 1.0310762 May 25 15:49:52.508961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:52.531597 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Pushing event updated for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=3']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:52.534984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:52.557272 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110', 'status': 'completed', 'code': 200} May 25 15:49:52.653471 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-1c3a4449-e6dc-45e0-8811-2d9a816e640d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:52.654979 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-1c3a4449-e6dc-45e0-8811-2d9a816e640d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 1097 time: 0.0760608 May 25 15:49:52.732202 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-2da3dbb2-e4b8-4f62-8bde-6ebd9931b877 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1edf8be0-5889-4766-ae81-82de066f9110 HTTP/1.1" status: 200 len: 217 time: 0.0599442 May 25 15:49:52.802572 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-b1c4f383-b0cf-4bc4-9e94-fe211088d255 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:52.804093 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-b1c4f383-b0cf-4bc4-9e94-fe211088d255 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0623603 May 25 15:49:52.852384 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-3a81ac42-22ce-4256-a8cb-9ef9304e20fa service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0405359 May 25 15:49:53.076208 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-13853a8f-1924-41a5-a627-dcbdb9c11abc service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2102730 May 25 15:49:53.239955 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baeb99b7-3e42-41f1-a695-00f5adb1f8de req-b7b69ed8-68b7-4a3e-a4c6-9c08077bf134 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:53.241408 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-baeb99b7-3e42-41f1-a695-00f5adb1f8de req-b7b69ed8-68b7-4a3e-a4c6-9c08077bf134 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 944 time: 0.0789115 May 25 15:49:53.267730 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9492d13b-1f96-4f50-b01b-3e3a68ff3e0e req-559019ba-4703-43d8-82d7-8d15e31cc8d2 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1809888 May 25 15:49:53.282525 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca35e8dd-591a-4e7a-a17c-e044640b65eb req-89e6e612-6b39-4a96-8809-da03030f25ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:53.283991 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca35e8dd-591a-4e7a-a17c-e044640b65eb req-89e6e612-6b39-4a96-8809-da03030f25ca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.1301627 May 25 15:49:53.285794 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-baeb99b7-3e42-41f1-a695-00f5adb1f8de req-363bf1a9-ed4f-494f-98b3-a6eaa2d6c398 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386360 May 25 15:49:53.330145 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca35e8dd-591a-4e7a-a17c-e044640b65eb req-b9e0bf88-1518-4fab-a23f-14402a8f2e2e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394177 May 25 15:49:53.401966 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-1f0b5aac-6415-473c-be91-fd1b406e7997 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:53.403765 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-1f0b5aac-6415-473c-be91-fd1b406e7997 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=6e1f97f6101d466a9c224075352387d8&device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 1097 time: 0.0706677 May 25 15:49:53.551095 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-d47e7bee-3de6-4116-9480-d616cd956e1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:53.552704 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-d47e7bee-3de6-4116-9480-d616cd956e1c service neutron] 10.222.0.70 "GET /v2.0/networks?id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 200 len: 916 time: 0.1282082 May 25 15:49:53.631982 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-b8b5bdb5-480e-43ab-910e-39601d6133c7 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1edf8be0-5889-4766-ae81-82de066f9110 HTTP/1.1" status: 200 len: 217 time: 0.0668809 May 25 15:49:53.707106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-f6144ced-2137-4b5c-8b54-223628f92e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:53.708712 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-f6144ced-2137-4b5c-8b54-223628f92e1a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 200 len: 855 time: 0.0657709 May 25 15:49:53.766385 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-47c93415-7d4b-4f45-a1ee-915f8bbbd16b service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0463898 May 25 15:49:53.911947 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-12661fdd-b852-4d84-ad7f-458ef3fd6933 service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1297240 May 25 15:49:54.049766 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ba51b222-2954-40a2-9cb7-6ba2ec30bf24 req-dc7f30bd-1b74-4b39-ab59-e87653a12abb service neutron] 10.222.0.70 "GET /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1251259 May 25 15:49:54.477909 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 req-d1abf935-47b0-4a90-ae21-13ad5655947a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:54.479348 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 req-d1abf935-47b0-4a90-ae21-13ad5655947a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 944 time: 0.0849733 May 25 15:49:54.514718 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 req-4908cf25-b87d-4b82-9258-f6c0516b7274 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:54.517026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 req-4908cf25-b87d-4b82-9258-f6c0516b7274 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 943 time: 0.0805616 May 25 15:49:54.523927 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-7fab4e0f-785c-421d-9ed6-8dee7e060f60 req-572a13b4-3f7e-4be9-902d-77daaaa6aaf3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387113 May 25 15:49:54.560083 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a5b2458a-644c-45cd-aebc-74e2ff04ca62 req-bedb0de2-4270-4a6e-bdb1-4aadfbb790d4 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375514 May 25 15:49:54.859293 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b62764e4-ba3e-4187-9554-db7555c582f2 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:49:54.990803 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b62764e4-ba3e-4187-9554-db7555c582f2,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:55.005386 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'port_id': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'mac_address': 'fa:16:3e:5d:b4:11', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 377, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:49:55.059257 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:55.077846 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b62764e4-ba3e-4187-9554-db7555c582f2 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:55.095599 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b62764e4-ba3e-4187-9554-db7555c582f2,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:55.099739 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:55.102565 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:55.175672 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:55.178929 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:55.572835 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['b62764e4-ba3e-4187-9554-db7555c582f2'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:55.752259 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f req-748fbfb7-e57d-4f38-b993-5d6fa6d818f5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:55.755802 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f req-748fbfb7-e57d-4f38-b993-5d6fa6d818f5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 944 time: 0.1159511 May 25 15:49:55.802276 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-653d2afe-0e97-4cab-9573-4512a6b6c01f req-23fa707f-9cd3-4b2e-9ab1-831111cafb39 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:55.804409 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-653d2afe-0e97-4cab-9573-4512a6b6c01f req-23fa707f-9cd3-4b2e-9ab1-831111cafb39 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 944 time: 0.1122580 May 25 15:49:55.806397 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-f1bb6e8c-28eb-41e5-9b12-0039dfe4bc5f req-58116f35-d706-4ea8-961b-be7299734693 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448623 May 25 15:49:55.861618 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-653d2afe-0e97-4cab-9573-4512a6b6c01f req-08916042-8d74-45a9-9342-5aa34945d26b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445716 May 25 15:49:56.867540 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 1edf8be0-5889-4766-ae81-82de066f9110 details requested by agent hyperv_hv-cinder-79123 with host hv-cinder-79123 {{(pid=98464) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 15:49:57.003798 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 req-880c7d07-a7a7-4330-b44d-f8901379c877 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:57.005336 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 req-880c7d07-a7a7-4330-b44d-f8901379c877 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 944 time: 0.0839825 May 25 15:49:57.012542 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=1edf8be0-5889-4766-ae81-82de066f9110,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:57.027562 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Returning: {'device': '1edf8be0-5889-4766-ae81-82de066f9110', 'network_id': '247feda9-7b6d-4c87-abaf-0b9c5d89f2d3', 'port_id': '1edf8be0-5889-4766-ae81-82de066f9110', 'mac_address': 'fa:16:3e:31:ba:07', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 350, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=98464) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 15:49:57.051228 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c3d25f0b-c83f-4c39-952d-fe01e2c45542 req-10192a2c-e37d-4c75-b094-874e373a8efe tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395422 May 25 15:49:57.061733 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 req-fdec6ba1-7fb1-46f3-9501-8fbbab054303 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:57.063442 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 req-fdec6ba1-7fb1-46f3-9501-8fbbab054303 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 944 time: 0.0862017 May 25 15:49:57.113712 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-40f0ad1a-7ecf-4b71-8e9c-7faa78edc023 req-3bf63d6d-bfa8-4426-82ba-a6f1457ba1d5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441420 May 25 15:49:57.115282 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:57.131730 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1edf8be0-5889-4766-ae81-82de066f9110 {{(pid=98464) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 15:49:57.147299 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=1edf8be0-5889-4766-ae81-82de066f9110,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:57.151070 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:57.152774 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:57.215183 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=4']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:57.218598 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:57.557072 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['1edf8be0-5889-4766-ae81-82de066f9110'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:49:57.623914 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50136) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:57.669293 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:49:57.683434 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.db_base_plugin_v2 [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Deleting subnet ea9f8f10-1713-40f3-bf0d-37210f1ec406 {{(pid=98463) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:49:57.686672 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:57.739499 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10571806'] for subnet, precommit_delete_associations {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:57.792666 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.126826 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1737199', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10999118'] for subnet, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.130459 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-017f8b97-a2ad-4f11-b36c-cbd2f778895e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.167560 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ea9f8f10-1713-40f3-bf0d-37210f1ec406,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:58.171025 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.172551 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] Notify callbacks [] for subnet, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.214183 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-9863542a-dcaa-4ea0-8ee1-837c95873eb9 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/ea9f8f10-1713-40f3-bf0d-37210f1ec406 HTTP/1.1" status: 204 len: 168 time: 0.5885944 May 25 15:49:58.216769 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50144) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:58.257534 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5629cce-890e-4129-8800-d930bc9db007 req-c6fb91d9-78b9-4036-920b-3a11af7ac7f7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:58.258991 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b5629cce-890e-4129-8800-d930bc9db007 req-c6fb91d9-78b9-4036-920b-3a11af7ac7f7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 945 time: 0.0926151 May 25 15:49:58.304273 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b5629cce-890e-4129-8800-d930bc9db007 req-e16d02f7-6071-4ef2-b7fa-6c94d09e0c7d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395527 May 25 15:49:58.386461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.410770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1c58a6-9b71-477c-a952-effae252d57b req-ae8fb96b-0b8a-4218-a159-02f3d41aefeb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:58.412266 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff1c58a6-9b71-477c-a952-effae252d57b req-ae8fb96b-0b8a-4218-a159-02f3d41aefeb tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 944 time: 0.1749237 May 25 15:49:58.657515 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ff1c58a6-9b71-477c-a952-effae252d57b req-74003f82-19ff-4db7-b1bf-743be62105dc tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2200155 May 25 15:49:58.658892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.671797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['67cb9c19-71a2-40aa-9c97-b6a69180cb24']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:58.683741 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9892984c-772c-463e-ae7a-d371f24f37ea') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:58.684083 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9892984c-772c-463e-ae7a-d371f24f37ea') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:58.695145 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.714253 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.721032 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Releasing vlan 385 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:49:58.721585 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:49:58.734883 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:49:58.806576 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.815458 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:58.828351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.837441 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Pushing event deleted for resources: {'Network': ['ID=67cb9c19-71a2-40aa-9c97-b6a69180cb24,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:58.839801 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] 10.222.0.36 "DELETE /v2.0/networks/67cb9c19-71a2-40aa-9c97-b6a69180cb24 HTTP/1.1" status: 204 len: 168 time: 0.6209669 May 25 15:49:58.840726 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2f8bf747-c1bc-41ec-90ce-dc4a8467c75a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:58.842520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50148) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:58.874006 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 1edf8be0-5889-4766-ae81-82de066f9110 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:49:58.904890 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Deleting subnet d2fd4444-ae91-4a70-8e60-4700b2139715 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:49:58.908184 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.941888 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port 1edf8be0-5889-4766-ae81-82de066f9110 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:49:58.946389 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port 1edf8be0-5889-4766-ae81-82de066f9110 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:49:58.946773 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:58.957755 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.015769 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.068511 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.095086 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:49:59.104950 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=1edf8be0-5889-4766-ae81-82de066f9110,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:59.110483 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.111619 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b62764e4-ba3e-4187-9554-db7555c582f2 up at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 15:49:59.144643 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.180735 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110', 'code': 200} May 25 15:49:59.235646 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:59.240990 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.251761 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning for port b62764e4-ba3e-4187-9554-db7555c582f2 completed by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 15:49:59.257217 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.provisioning_blocks [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Provisioning complete for port b62764e4-ba3e-4187-9554-db7555c582f2 triggered by entity L2. {{(pid=98464) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 15:49:59.257602 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3902000'] for port, provisioning_complete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.264635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.270488 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.310035 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d2fd4444-ae91-4a70-8e60-4700b2139715,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:59.312561 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.315092 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.319166 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-1ca9d363-e918-4372-9ff3-6411db5b0fd0 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/d2fd4444-ae91-4a70-8e60-4700b2139715 HTTP/1.1" status: 204 len: 168 time: 0.4750814 May 25 15:49:59.322450 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50154) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:59.396699 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.402535 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d7ab79-10ee-4a94-9b3b-d9501175036d req-7cb80dce-5814-4aa3-b7cc-f0e7deac2551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:59.404994 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-33d7ab79-10ee-4a94-9b3b-d9501175036d req-7cb80dce-5814-4aa3-b7cc-f0e7deac2551 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 1099 time: 0.0848370 May 25 15:49:59.434669 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b62764e4-ba3e-4187-9554-db7555c582f2,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:49:59.439175 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.440382 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102'] for port, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.442569 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.514423 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-33d7ab79-10ee-4a94-9b3b-d9501175036d req-f666136c-8fe4-48bf-b89b-342197aa99d5 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971003 May 25 15:49:59.515557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Pushing event updated for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=5']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:59.521113 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.541708 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8aab7187-e994-4a37-884c-93caa9528058 req-61e01016-3bbf-45e9-9bea-224972948076 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:59.543249 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8aab7187-e994-4a37-884c-93caa9528058 req-61e01016-3bbf-45e9-9bea-224972948076 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.1116929 May 25 15:49:59.570156 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.582787 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['09519bd2-e90e-48d3-acf0-170fd34e172d']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:59.588880 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8aab7187-e994-4a37-884c-93caa9528058 req-f709e46d-f4af-43d2-adf3-16191cd816a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394068 May 25 15:49:59.594919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6d61ba9f-9161-4af1-9496-a0f7b8ebee46') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:59.595214 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6d61ba9f-9161-4af1-9496-a0f7b8ebee46') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:49:59.606633 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.623708 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.630230 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Releasing vlan 366 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:49:59.630609 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:49:59.643469 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:49:59.720709 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.724034 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:49:59.739413 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.745340 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Pushing event deleted for resources: {'Network': ['ID=09519bd2-e90e-48d3-acf0-170fd34e172d,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:49:59.748101 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:49:59.749834 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-73c0d350-6142-4842-9802-99be0853904e admin admin] 10.222.0.36 "DELETE /v2.0/networks/09519bd2-e90e-48d3-acf0-170fd34e172d HTTP/1.1" status: 204 len: 168 time: 0.4264133 May 25 15:49:59.855853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 req-e84d56a0-88cd-45da-8fc7-edc21c4642e1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:49:59.857319 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 req-e84d56a0-88cd-45da-8fc7-edc21c4642e1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0899613 May 25 15:49:59.903213 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-51d84d66-bd24-41c0-81f6-9d63a43d1dc1 req-26ed563f-0236-43d2-bf36-9fdfe8970832 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397396 May 25 15:49:59.926495 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50164) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:49:59.972941 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9b590f8d-78a8-4624-bf48-c5fd298780d1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:49:59.974794 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-575bfd42-a3b0-424e-8eba-0699ae47f527 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=c375986121c142cf92346a42e26695e6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0471139 May 25 15:49:59.977344 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50168) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:00.035318 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.059918 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.112911 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.117528 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-518981f0-ced4-4539-818f-4ab4f5b2f0e6 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.130556 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e0d7b0b0-7c30-4140-ab3f-d71aa0fd73cd,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:00.133896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:00.137196 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.138281 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-a6f750ba-2756-44ef-8822-a04aa7858d4f admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/e0d7b0b0-7c30-4140-ab3f-d71aa0fd73cd HTTP/1.1" status: 204 len: 168 time: 0.1600363 May 25 15:50:00.473460 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50176) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:00.523002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-534ead6c-6584-4807-8f98-0857d3624fa6 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=87e7763a9c514433b22c0abf4431c774&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0482543 May 25 15:50:00.525229 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50180) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:00.582070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.607141 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.668436 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.672165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-bd37a53d-2cb6-4480-ae78-4562c1aa9327 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:00.684771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=09f642a5-9b66-42f9-8344-0ebfff107f38,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:00.688548 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:00.691889 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:00.695818 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/09f642a5-9b66-42f9-8344-0ebfff107f38 HTTP/1.1" status: 204 len: 168 time: 0.1696405 May 25 15:50:00.790684 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ee3888-44ea-4993-ac02-c6db654ed235 req-293c35dc-a3f9-4969-b025-917e6601b54d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:00.792458 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-66ee3888-44ea-4993-ac02-c6db654ed235 req-293c35dc-a3f9-4969-b025-917e6601b54d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0955958 May 25 15:50:00.843491 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-66ee3888-44ea-4993-ac02-c6db654ed235 req-1537ee26-3218-4391-8433-f38a4dad5f47 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450077 May 25 15:50:01.089429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f071866-73d9-4fdb-8e44-d342cdf2c923 req-d188f3cb-81f0-45a0-89dd-66f2de3f3201 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:01.090890 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f071866-73d9-4fdb-8e44-d342cdf2c923 req-d188f3cb-81f0-45a0-89dd-66f2de3f3201 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0810416 May 25 15:50:01.135826 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-2f071866-73d9-4fdb-8e44-d342cdf2c923 req-497b1078-3135-47b8-9cdc-c3da64ee62a5 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393584 May 25 15:50:01.181636 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2'}] {{(pid=98464) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:01.226219 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'code': 200} May 25 15:50:01.523580 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecb368c-e36c-4ec3-be01-de782c1cc6f9 req-e23b2515-ae81-4435-bb36-19eb03770cb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:01.525125 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8ecb368c-e36c-4ec3-be01-de782c1cc6f9 req-e23b2515-ae81-4435-bb36-19eb03770cb0 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1098 time: 0.0756867 May 25 15:50:01.571002 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8ecb368c-e36c-4ec3-be01-de782c1cc6f9 req-f3e2faab-f5c4-4a44-b1d4-2272853d3f34 service neutron] 10.222.0.70 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338449 May 25 15:50:02.034967 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-446179fe-3c38-4083-98e5-0334cd238d95 req-f7b6b6aa-cc35-4727-a3b5-f3026f820257 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:02.036454 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-446179fe-3c38-4083-98e5-0334cd238d95 req-f7b6b6aa-cc35-4727-a3b5-f3026f820257 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0841594 May 25 15:50:02.082619 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-446179fe-3c38-4083-98e5-0334cd238d95 req-9cd3ce87-35f0-4811-892e-9a596512ae1f tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399499 May 25 15:50:02.332925 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 req-494b8840-871c-4592-8e44-b27a77c78143 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:02.334436 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 req-494b8840-871c-4592-8e44-b27a77c78143 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0884073 May 25 15:50:02.382948 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a3403e1b-aec7-4c69-9bbd-bff0659ac1d1 req-0848675a-95f1-4826-9dc1-35a8a092fa62 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419178 May 25 15:50:02.645621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:02.696539 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-02c6f2e7-d218-40c7-9834-75859a74ae00 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.471574 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:03.572476 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf65a79-8b9b-4edb-a388-818853bc379a req-9f94c4cc-a276-4275-a518-73e9592ff842 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:03.573947 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3cf65a79-8b9b-4edb-a388-818853bc379a req-9f94c4cc-a276-4275-a518-73e9592ff842 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0811124 May 25 15:50:03.617956 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-3cf65a79-8b9b-4edb-a388-818853bc379a req-00f94b20-1d90-4205-bd9c-763b25844921 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377474 May 25 15:50:03.811500 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be485876-19a4-4d8d-baa8-5a4f6fa16efb req-2fc3ce7f-627c-4bf1-b3c1-d94cdf050952 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:03.811500 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be485876-19a4-4d8d-baa8-5a4f6fa16efb req-2fc3ce7f-627c-4bf1-b3c1-d94cdf050952 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0874846 May 25 15:50:03.862197 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-be485876-19a4-4d8d-baa8-5a4f6fa16efb req-6abeec2a-7a18-4304-af68-f1a9d05afb5d tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410182 May 25 15:50:03.888062 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50260) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:04.152520 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ee51098-a9e5-4960-9e6e-1ee10d20de01 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:04.154095 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-8ee51098-a9e5-4960-9e6e-1ee10d20de01 tempest-TestVolumeBootPattern-1255373324 tempest-TestVolumeBootPattern-1255373324-project-admin] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1093 time: 0.2648950 May 25 15:50:04.157626 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50272) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:04.162943 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.v2.base [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Request body: {'floatingip': {'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'port_id': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address': '172.20.0.7'}} {{(pid=98462) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 15:50:04.169428 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:04.174200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Usage tracker for resource:floatingip and tenant:8dff1003ceba47f6a75b4c3901343b7b is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:04.177362 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:04.183695 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:04.195880 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.351286 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.502065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_common [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Allocated IP 172.27.0.14 (5faa42c5-bc4c-4066-864c-fb4aa8b3c7da/ffbac48b-f0bf-4296-959e-36eeb4ffe30f/9df71888-92f1-4abd-9f77-68fd45f6110a) {{(pid=98462) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 15:50:04.735332 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.769168 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8752733804755', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:04.773683 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e6b52f26-7442-4757-8cb8-e6e038f004b1 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:04.835086 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Network 5faa42c5-bc4c-4066-864c-fb4aa8b3c7da is already hosted by enough agents. {{(pid=98462) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 15:50:04.837582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.base_scheduler [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Resources bound (agent type, host, resource id): {{(pid=98462) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 15:50:04.841146 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Received port after_create {{(pid=98462) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 15:50:04.875333 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=9df71888-92f1-4abd-9f77-68fd45f6110a,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:04.879557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:05.192962 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.253946 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.331324 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3734790'] for port, before_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.542277 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for port, precommit_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.547797 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8752734189460', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8752733804773', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8752733806102', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-1998688'] for port, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.552449 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4dfcd664-7f87-4b0c-93d0-55d594abebd8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:05.660759 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event updated for resources: {'Port': ['ID=9df71888-92f1-4abd-9f77-68fd45f6110a,revision_number=2']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:05.665325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:05.669892 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-762900'] for floatingip, after_update {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:05.854999 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.db.l3_db [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP 6a0eb770-91b6-4651-911e-53ffd82a35c4 associated. External IP: 172.27.0.14, port: b62764e4-ba3e-4187-9554-db7555c582f2. May 25 15:50:06.302760 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:06.483728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:06.494905 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:06.504895 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:06.505363 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:06.508514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:06.563569 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.4048417 May 25 15:50:06.564254 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:06.607236 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'status': 'completed', 'code': 200} May 25 15:50:06.685146 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:06.717774 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-58f060cc-45bc-4ef0-9204-711d85d0eb7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:06.719311 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-58f060cc-45bc-4ef0-9204-711d85d0eb7f service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1098 time: 0.0722399 May 25 15:50:06.864396 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-321bd59f-a8a4-41aa-bf79-a6a762ace651 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:06.865859 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-321bd59f-a8a4-41aa-bf79-a6a762ace651 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1284540 May 25 15:50:06.973090 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-6c1b6f8c-8f8a-4f60-8717-1f675099d284 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 200 len: 998 time: 0.0992327 May 25 15:50:07.042466 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6a0eb770-91b6-4651-911e-53ffd82a35c4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:5d:b4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:05Z', 'updated_at': '2021-05-25T15:50:05Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}, {'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:07.047265 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:07.051014 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-fd5dcbc2-1367-4ee7-8ea3-17f62de2f9bc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:07.053915 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-fd5dcbc2-1367-4ee7-8ea3-17f62de2f9bc service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0641556 May 25 15:50:07.055825 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:07.056471 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:07.137384 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-87988f8f-092d-4128-a581-f7d121b9a323 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:07.138936 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-87988f8f-092d-4128-a581-f7d121b9a323 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0715315 May 25 15:50:07.283756 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-45088af5-0dd0-4dfa-befd-50070064e75c service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1350689 May 25 15:50:07.286842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:07.443155 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-6730226b-3c1b-47dd-8297-650f4393a4a6 req-7c3de220-d8c1-4bb1-b2be-e903c3df12a3 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1472683 May 25 15:50:07.680368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6a0eb770-91b6-4651-911e-53ffd82a35c4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:5d:b4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:05Z', 'updated_at': '2021-05-25T15:50:05Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}, {'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:07.684342 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7321e84c-7d78-4449-827f-83ef6d5b2b7d None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '6a0eb770-91b6-4651-911e-53ffd82a35c4', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.14', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 627, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:5d:b4:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:50:05Z', 'updated_at': '2021-05-25T15:50:05Z', 'revision_number': 0, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}, {'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:07.862254 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-575cf112-a41e-464c-a1b4-600a27ed7463 None None] New status for floating IP 6a0eb770-91b6-4651-911e-53ffd82a35c4: ACTIVE {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:50:12.685530 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:12.807631 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50348) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:12.925400 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:12.939937 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:12.944123 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Usage tracker for resource:security_group_rule and tenant:2b1080ddac3340e394acbd78e30dfeba is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:12.947013 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:12.952786 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:13.043908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.048771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.055945 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a08534f3-194d-4192-ab0c-5913e428c003 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.100273 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28be01d9-7b2a-49f8-b71e-62180c95334f,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:13.104445 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=2b1080ddac3340e394acbd78e30dfeba&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2956996 May 25 15:50:13.105325 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-36d2bd75-4a98-49b2-800b-cd91d8c57bb5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.107116 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50360) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:13.165162 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.191968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.243936 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.249281 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0f52c8f0-6a4e-4c65-8685-f4dc362d6d9d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.262677 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28be01d9-7b2a-49f8-b71e-62180c95334f,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:13.265259 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.266669 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.271014 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a78f4b0f-2511-4b86-8e0a-a4a8efd41eaf admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/28be01d9-7b2a-49f8-b71e-62180c95334f HTTP/1.1" status: 204 len: 168 time: 0.1629689 May 25 15:50:13.557064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50378) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:13.576414 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.591397 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:13.595245 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Usage tracker for resource:security_group_rule and tenant:e1760c5836984769a99651863afb9d24 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:13.598633 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:13.604372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:13.691799 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.695398 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.703551 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-50020d97-42b8-4642-99a9-ef9b7cc82d3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.741892 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=e1760c5836984769a99651863afb9d24&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1837394 May 25 15:50:13.743451 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1eb3ac91-cd73-4ae4-b747-377dd18187f9,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:13.744592 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50382) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:13.746435 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2348560b-8cd9-41c2-8801-1971c3ec764b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.803869 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.829652 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.881203 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.886023 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-a28d4510-48dc-4b18-a8a9-a34a11ef4849 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:13.898804 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1eb3ac91-cd73-4ae4-b747-377dd18187f9,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:13.901232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:13.903359 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:13.907983 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/1eb3ac91-cd73-4ae4-b747-377dd18187f9 HTTP/1.1" status: 204 len: 168 time: 0.1623497 May 25 15:50:15.288403 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50428) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:15.403306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.418197 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:15.421991 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Usage tracker for resource:security_group_rule and tenant:fe46157079124738b220c84b47834132 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:15.425343 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:15.430971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:15.510457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.514160 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.522481 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b9139222-3667-4352-b569-698213534a54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:15.560564 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=fe46157079124738b220c84b47834132&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2710922 May 25 15:50:15.562064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4085c394-2fc9-4843-a0e3-5da8e44b72de,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:15.563171 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50434) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:15.565122 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-2c5cc201-7be3-4c4c-9082-b1dd62b682ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:15.624346 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.649147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.701887 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.706494 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c93c2623-c3a9-4eb0-b7c0-02c1b7ab6a58 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:15.717355 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4085c394-2fc9-4843-a0e3-5da8e44b72de,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:15.724288 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:15.725217 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:15.728823 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/4085c394-2fc9-4843-a0e3-5da8e44b72de HTTP/1.1" status: 204 len: 168 time: 0.1646626 May 25 15:50:16.105165 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-cd2e2035-159a-4c2b-8e58-be8dd2f79903 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2813072 May 25 15:50:16.258887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-259fd5cc-25ba-402f-97c5-dfd93a71a280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:16.260467 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-259fd5cc-25ba-402f-97c5-dfd93a71a280 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.0770853 May 25 15:50:16.422990 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-7bd3586c-525e-41cc-87e9-33bd4af13116 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:16.425114 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-7bd3586c-525e-41cc-87e9-33bd4af13116 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.1341136 May 25 15:50:16.533821 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-4932b438-731a-4fca-ad1d-2ec897aa2702 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 1002 time: 0.1001167 May 25 15:50:16.611493 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-746e3f79-9405-426e-bcaa-232f3151369a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:16.612982 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-746e3f79-9405-426e-bcaa-232f3151369a service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.0609794 May 25 15:50:16.707153 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-59029176-639c-4f2c-be91-4a1057e89dcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:16.708739 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-59029176-639c-4f2c-be91-4a1057e89dcc service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0712636 May 25 15:50:16.733370 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-0e15bc7c-6c46-4ee9-8d8f-5435f07fa4e5 service neutron] http://10.222.0.36:9696/v2.0/extensions returned with HTTP 200 {{(pid=98462) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 15:50:16.734328 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-0e15bc7c-6c46-4ee9-8d8f-5435f07fa4e5 service neutron] 10.222.0.70 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052917 May 25 15:50:16.873409 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-2aa7836d-590f-466f-a060-1de64d6175be service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1269770 May 25 15:50:17.032890 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-79d2dbb3-33ae-4382-b301-785c68b8df98 req-8dc1125b-7c01-4e73-8dbe-46a5391821b6 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1446691 May 25 15:50:17.395340 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ef4c63-adab-4fe6-af21-650e47eae06d req-9f3b3721-6953-4f20-b036-35b3a508979c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:17.396753 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d3ef4c63-adab-4fe6-af21-650e47eae06d req-9f3b3721-6953-4f20-b036-35b3a508979c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0867038 May 25 15:50:17.444276 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d3ef4c63-adab-4fe6-af21-650e47eae06d req-77153682-618e-42e8-b3e7-1b97751de82b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413313 May 25 15:50:18.428050 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50486) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:18.894964 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66eac227-5883-4451-a4ce-196755a9d7f3 req-ac69a172-6f20-47c0-97af-da929f697eab tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:18.896352 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-66eac227-5883-4451-a4ce-196755a9d7f3 req-ac69a172-6f20-47c0-97af-da929f697eab tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.3430591 May 25 15:50:18.996054 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-66eac227-5883-4451-a4ce-196755a9d7f3 req-433d67bf-e849-4c3d-8277-c16479c4c213 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0925384 May 25 15:50:19.014264 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Deleting port cd1cbcaf-cb70-4822-be0f-d1207ecf75f5 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:19.014608 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:19.131474 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:19.131802 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:19.252456 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling delete_port for cd1cbcaf-cb70-4822-be0f-d1207ecf75f5 owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:19.377513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:19.381756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-29674645-86e5-41ce-a489-9251f407d61b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:19.426696 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event deleted for resources: {'Port': ['ID=cd1cbcaf-cb70-4822-be0f-d1207ecf75f5,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:19.459502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:19.516130 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:19.516699 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Floating IP 386a1c8f-795c-4a8d-9633-1b03e066ac0d disassociated (deleted). External IP: 172.27.0.106, port: 7ae06ec7-6469-494a-b223-ce3de0a0e2da. May 25 15:50:19.868875 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Router 333e9bb6-af7f-4e54-8e33-f669ec06856d has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:20.162220 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:20.173885 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Sync routers for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:20.184091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:20.184275 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:20.184991 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:20.189114 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 req-88d0e7d6-c3b1-40f0-8793-db02d5f17ce6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:20.190654 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 req-88d0e7d6-c3b1-40f0-8793-db02d5f17ce6 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0866618 May 25 15:50:20.238385 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-69911101-cf45-4a9d-ad3e-d373ad4b70c4 req-c6ecb99f-4d92-430b-aa9b-68fcb4db44aa tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414152 May 25 15:50:20.246690 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-504b01c8-5335-4437-8577-a651c4a90bec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "DELETE /v2.0/floatingips/386a1c8f-795c-4a8d-9633-1b03e066ac0d HTTP/1.1" status: 204 len: 168 time: 1.8175075 May 25 15:50:20.247584 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:20.294387 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'status': 'completed', 'code': 200} May 25 15:50:20.373048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:20.628305 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93010a0a-67db-4070-a7a0-bd26022472a0 req-e5fcaeab-9504-4081-b4e2-772f88fc1a27 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:20.629756 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93010a0a-67db-4070-a7a0-bd26022472a0 req-e5fcaeab-9504-4081-b4e2-772f88fc1a27 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0830109 May 25 15:50:20.674005 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-93010a0a-67db-4070-a7a0-bd26022472a0 req-f4671c9b-214f-40ac-bd9f-85afed77cdec tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382435 May 25 15:50:20.692160 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:20.695989 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Checking router: 333e9bb6-af7f-4e54-8e33-f669ec06856d for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:20.704219 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:20.704815 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:20.881399 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:21.227268 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-eeead518-73df-4847-845d-68ff1110a855 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:21.231227 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eeead518-73df-4847-845d-68ff1110a855 None None] The sync data for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi is: [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:44:31Z', 'revision_number': 4, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': '462d06b3-a029-444b-bf67-dda89e9f0a73', 'name': '', 'network_id': 'bef3b39e-4efb-47b6-ab09-ddc4c406ab32', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'mac_address': 'fa:16:3e:8c:d5:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_interface', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:30Z', 'updated_at': '2021-05-25T15:44:35Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'subnets': [{'id': 'ce334cf7-ad8f-4d17-8efa-939b870abd6d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:21.431591 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e32e0e65-c25c-4d84-b2fa-15bca51cb4c1 None None] New status for floating IP 386a1c8f-795c-4a8d-9633-1b03e066ac0d: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:50:21.432774 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d85efb24-3598-4533-9c84-0898125de5fd req-bd6544b3-392d-4317-a841-527f45afb3b7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:21.434476 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d85efb24-3598-4533-9c84-0898125de5fd req-bd6544b3-392d-4317-a841-527f45afb3b7 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0847127 May 25 15:50:21.484158 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d85efb24-3598-4533-9c84-0898125de5fd req-83c5d158-7c5c-4293-9c8e-06a4d05388cd tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431361 May 25 15:50:21.858698 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1de50a2-3e17-4df1-b9d8-36bc639b566b req-d0e65e1b-44cd-45e3-b4e3-d5aba2f6c98f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:21.860199 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1de50a2-3e17-4df1-b9d8-36bc639b566b req-d0e65e1b-44cd-45e3-b4e3-d5aba2f6c98f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0807111 May 25 15:50:21.904142 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1de50a2-3e17-4df1-b9d8-36bc639b566b req-5d435996-8d4f-4a6c-89ba-f5cce235b89e tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381863 May 25 15:50:22.673094 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5adc47e8-1c78-4117-8309-a6b2390c743c req-e1ecbf22-e233-4728-bff5-25677d0a6f21 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:22.674552 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5adc47e8-1c78-4117-8309-a6b2390c743c req-e1ecbf22-e233-4728-bff5-25677d0a6f21 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0789230 May 25 15:50:22.717301 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-5adc47e8-1c78-4117-8309-a6b2390c743c req-5148f3f4-a65c-4164-a2b3-ebde5a604fb8 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0372791 May 25 15:50:22.947339 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-4926e90d-7d68-44a3-8be7-9b95f773682d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:22.948859 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-4926e90d-7d68-44a3-8be7-9b95f773682d service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=9276d22c6df545f2a056d5059899b85f&device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 1099 time: 0.0741799 May 25 15:50:23.146569 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-eea8e17b-ee5e-4dbb-ae1a-3a4b5c5c3847 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.148010 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-eea8e17b-ee5e-4dbb-ae1a-3a4b5c5c3847 service neutron] 10.222.0.70 "GET /v2.0/networks?id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 200 len: 910 time: 0.1833949 May 25 15:50:23.162426 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feab133-e146-4616-aa3a-f1cfb31a58af req-28d31d89-69cb-4f74-b2bc-382d8762dd73 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.163832 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2feab133-e146-4616-aa3a-f1cfb31a58af req-28d31d89-69cb-4f74-b2bc-382d8762dd73 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1296999 May 25 15:50:23.240181 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-2440b3a6-b1cf-44be-8deb-5b43cd94fbd7 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 200 len: 217 time: 0.0752659 May 25 15:50:23.385643 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-2feab133-e146-4616-aa3a-f1cfb31a58af req-b45c6737-99d2-4b71-8d0b-c872de67f742 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1738582 May 25 15:50:23.408159 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-2f576a36-b450-495b-afc5-3dd86c4869a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.409596 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-2f576a36-b450-495b-afc5-3dd86c4869a6 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 200 len: 848 time: 0.1575844 May 25 15:50:23.495072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-7ea3bb27-90d4-488c-9991-2e8a38c3b590 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.496572 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-7ea3bb27-90d4-488c-9991-2e8a38c3b590 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=bef3b39e-4efb-47b6-ab09-ddc4c406ab32&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0711017 May 25 15:50:23.638895 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-c38a2e77-eb4f-4848-94bc-4aeb19f7cc29 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1274202 May 25 15:50:23.788085 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a14aa4f0-84ca-44f6-8dae-46f7567d5ccb req-c98dc22e-cad0-4aae-9056-d8fcbbd3bfc5 service neutron] 10.222.0.70 "GET /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1299832 May 25 15:50:23.909166 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-088c67de-4e0a-45a3-9adb-4584741586fa tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.910646 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-088c67de-4e0a-45a3-9adb-4584741586fa tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0892053 May 25 15:50:23.924781 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a req-c1a3ab8d-a663-4a44-a2c7-f6578a1c36ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:23.926442 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a req-c1a3ab8d-a663-4a44-a2c7-f6578a1c36ac tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 946 time: 0.0917375 May 25 15:50:23.971815 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-dc78fd10-4464-40a1-8f95-1fb6c5ac323a req-43acd9bb-2acd-4369-ad78-c185f78bf771 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390811 May 25 15:50:24.048046 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Deleting port 1edf8be0-5889-4766-ae81-82de066f9110 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:24.048638 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.177651 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] For port 1edf8be0-5889-4766-ae81-82de066f9110, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=1edf8be0-5889-4766-ae81-82de066f9110,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:24.178003 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.301171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling delete_port for 1edf8be0-5889-4766-ae81-82de066f9110 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:24.408148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.413645 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:24.461314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event deleted for resources: {'Port': ['ID=1edf8be0-5889-4766-ae81-82de066f9110,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:24.464446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:24.579054 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] No DVR routers for this DVR port 1edf8be0-5889-4766-ae81-82de066f9110 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:24.582850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:24.585300 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'name': 'network-vif-deleted', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:24.620337 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-94d6e86c-d617-4e24-837f-f335bdb52b5c req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "DELETE /v2.0/ports/1edf8be0-5889-4766-ae81-82de066f9110 HTTP/1.1" status: 204 len: 173 time: 0.7004232 May 25 15:50:24.630032 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2596d47a-e4cc-4252-9e3f-bf7559a4cbda', 'name': 'network-vif-deleted', 'tag': '1edf8be0-5889-4766-ae81-82de066f9110', 'status': 'completed', 'code': 200} May 25 15:50:24.638106 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 req-0f3ba086-20ac-47e4-a560-c60d8b3bdd17 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:24.639530 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 req-0f3ba086-20ac-47e4-a560-c60d8b3bdd17 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1399412 May 25 15:50:24.684207 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ffc81ea8-5f0f-4323-9b5d-ca65c51280c7 req-d246d5d2-4cb5-4bad-a9cd-99683f27fa8f tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0386698 May 25 15:50:25.121745 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6b6821d8-131e-490a-a96a-eaa99f84b361 req-37f6c09a-e94b-411e-bdc8-0f9f087e6c32 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.0427382 May 25 15:50:25.865911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 req-85b86630-261e-4dcd-b239-70d93634f804 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:25.867362 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 req-85b86630-261e-4dcd-b239-70d93634f804 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0785110 May 25 15:50:25.914889 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5960b1d7-e16a-45bc-b8bf-7b3ab2b0c7e6 req-c5ecd781-9d12-40c9-b3cf-ceaeea023c07 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419388 May 25 15:50:26.270557 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-a34af552-1848-4e7c-8ffa-61d5a827f1fc req-7cea4329-a7c6-4f8e-9c7e-27ecc2668ea1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.0428154 May 25 15:50:26.801150 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e', '6fd10c0b-7953-4682-8b93-6b38d31fbca5', '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', '1edf8be0-5889-4766-ae81-82de066f9110'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:50:27.101599 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc0ebaa-45c6-4c30-a170-38394425667f req-88b8f36b-f5f9-4ee0-9b8d-4c7aad73935a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:27.102988 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5bc0ebaa-45c6-4c30-a170-38394425667f req-88b8f36b-f5f9-4ee0-9b8d-4c7aad73935a tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0809388 May 25 15:50:27.146910 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5bc0ebaa-45c6-4c30-a170-38394425667f req-0bec6092-bb89-4645-9f3a-1a2a0d10bb89 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383422 May 25 15:50:27.423494 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-c513f1d9-5623-4750-a580-f10bd9957105 req-4c7ff63b-425b-45fe-8d8b-af8c9ee560f5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.0486367 May 25 15:50:28.333993 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 req-f3368771-ed79-4632-afdc-d149482ab214 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:28.335455 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 req-f3368771-ed79-4632-afdc-d149482ab214 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.0822277 May 25 15:50:28.383081 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-8bb97f56-6e80-4f8f-b7e6-746c4685c7d2 req-d2d72dae-fc22-433f-8fe0-96a5f4ad0a05 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420136 May 25 15:50:28.595752 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-70196ba9-1210-4a2d-a5e4-f54f7aa2fdec req-7822aa19-39d8-4a5b-9bd5-26437bffef75 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=2596d47a-e4cc-4252-9e3f-bf7559a4cbda HTTP/1.1" status: 200 len: 210 time: 0.0445714 May 25 15:50:28.798319 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 1edf8be0-5889-4766-ae81-82de066f9110 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:28.833490 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 1edf8be0-5889-4766-ae81-82de066f9110 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:28.833847 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 1edf8be0-5889-4766-ae81-82de066f9110 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:29.716200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 req-7724c345-452f-4753-9a63-a71a43193049 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:29.717677 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 req-7724c345-452f-4753-9a63-a71a43193049 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.2303045 May 25 15:50:29.726431 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-2a5fea38-fd3a-4795-8fdb-98167a234693 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:29.727807 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-2a5fea38-fd3a-4795-8fdb-98167a234693 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.70 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.2089818 May 25 15:50:29.768851 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-759bef4b-625f-4d7d-a501-2ef5ebc956b4 req-405b73fc-0e6f-4db2-8f1f-3933a6c286ff tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400629 May 25 15:50:29.977417 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-9468778c-b9ed-49c7-8bfa-b90b6a07e201 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.858189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Deleting port 7ae06ec7-6469-494a-b223-ce3de0a0e2da {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:30.858813 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:30.974253 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf req-53318268-7fdf-4a6e-a796-4e8db5035298 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:30.974959 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf req-53318268-7fdf-4a6e-a796-4e8db5035298 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:30.990181 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf req-53318268-7fdf-4a6e-a796-4e8db5035298 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:30.991483 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf req-53318268-7fdf-4a6e-a796-4e8db5035298 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 946 time: 0.1144865 May 25 15:50:30.995483 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] For port 7ae06ec7-6469-494a-b223-ce3de0a0e2da, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=7ae06ec7-6469-494a-b223-ce3de0a0e2da,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:30.995896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.037768 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-b0647d53-d50b-4280-a4fc-7c7ae7f9b8cf req-0330be51-a3fe-4bfe-a6d7-8bd96c516e51 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/security-groups?id=a86a7244-7e4f-4df6-8ef2-406afb62650f&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400491 May 25 15:50:31.118023 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Calling delete_port for 7ae06ec7-6469-494a-b223-ce3de0a0e2da owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:31.225705 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.231049 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:31.279237 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event deleted for resources: {'Port': ['ID=7ae06ec7-6469-494a-b223-ce3de0a0e2da,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:31.282317 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:31.355155 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] No DVR routers for this DVR port 7ae06ec7-6469-494a-b223-ce3de0a0e2da on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:31.357570 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:31.360147 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-deleted', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:31.376762 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c24e59e9-4730-4820-832a-d36ffe7cc3c1 req-a2f2449a-ad08-4974-ac00-188b2a2ff516 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.70 "DELETE /v2.0/ports/7ae06ec7-6469-494a-b223-ce3de0a0e2da HTTP/1.1" status: 204 len: 173 time: 0.6488788 May 25 15:50:31.531960 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a4b8d3b0-aceb-4f56-a13d-7d0696f42901', 'name': 'network-vif-deleted', 'tag': '7ae06ec7-6469-494a-b223-ce3de0a0e2da', 'status': 'completed', 'code': 200} May 25 15:50:32.201108 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-edf6d1e0-7bec-4c80-beb5-1a54ed8f533b req-73711620-4fdb-4a21-9ae2-56f8b98cc118 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0429397 May 25 15:50:32.641259 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:32.696882 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-676bdb1c-87d0-4c1b-ad03-06e14fcbd0a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:33.348128 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 req-e02aeeab-e7cf-406f-9e4a-4bf7ba47cf15 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Synchronizing usage tracker for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:33.362923 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 req-e02aeeab-e7cf-406f-9e4a-4bf7ba47cf15 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Unset dirty status for tenant:9276d22c6df545f2a056d5059899b85f on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:33.364228 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-4b2474a9-42b0-4962-bbaf-a64db1698ad1 req-e02aeeab-e7cf-406f-9e4a-4bf7ba47cf15 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0588756 May 25 15:50:33.480515 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:33.645968 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:33.684482 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 7ae06ec7-6469-494a-b223-ce3de0a0e2da {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:33.684865 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 7ae06ec7-6469-494a-b223-ce3de0a0e2da not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:34.527627 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ad855b35-ff44-4dfa-8088-54e9409b8288 req-0edd1eb0-3be9-4a27-9a75-9f26e3215d77 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "GET /v2.0/ports?device_id=a4b8d3b0-aceb-4f56-a13d-7d0696f42901 HTTP/1.1" status: 200 len: 210 time: 0.0515881 May 25 15:50:34.667988 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:50:35.193760 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.622829 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50650) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:35.645601 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95949289-ad5d-4513-9571-e98831b17f00 req-19bd59e9-147a-43f5-b90d-dce6c7f27869 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:35.648072 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-95949289-ad5d-4513-9571-e98831b17f00 req-19bd59e9-147a-43f5-b90d-dce6c7f27869 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.0861678 May 25 15:50:35.691887 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-95949289-ad5d-4513-9571-e98831b17f00 req-42b3d7f8-0007-4fa3-9d96-84e7a46eaa98 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384092 May 25 15:50:35.695762 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.728202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.791539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.795118 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fc4c787d-cf2a-4471-8ed6-42c3b8665831 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:35.812144 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a86a7244-7e4f-4df6-8ef2-406afb62650f,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:35.821635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.821994 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.822349 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.822701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.823047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.823388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.823788 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.824173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.824516 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.824854 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.825190 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.825522 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:35.830271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:35.834582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:35.840348 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c185c230-c500-4515-a262-5d23a82ae5fb tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] 10.222.0.36 "DELETE /v2.0/security-groups/a86a7244-7e4f-4df6-8ef2-406afb62650f HTTP/1.1" status: 204 len: 168 time: 0.2164576 May 25 15:50:35.885451 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50656) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:36.525136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:36.879080 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 req-9530272e-70b5-47f8-aa50-4be898c7905d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:36.880587 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 req-9530272e-70b5-47f8-aa50-4be898c7905d tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.0797355 May 25 15:50:36.929921 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e638481e-c28b-48f2-a1e5-f1bc30d12d61 req-97d64a52-e981-4b5d-9d17-3d3021e4c27b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435653 May 25 15:50:37.037172 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Deleting port 462d06b3-a029-444b-bf67-dda89e9f0a73 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:37.037733 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.158003 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] For port 462d06b3-a029-444b-bf67-dda89e9f0a73, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=462d06b3-a029-444b-bf67-dda89e9f0a73,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:37.158360 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.280775 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Calling delete_port for 462d06b3-a029-444b-bf67-dda89e9f0a73 owned by network:router_interface {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:37.439766 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:37.444104 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a5e94633-2b7d-4d78-88e0-b50b6699accf tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:37.484904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Pushing event deleted for resources: {'Port': ['ID=462d06b3-a029-444b-bf67-dda89e9f0a73,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:37.488815 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:37.766473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:38.330344 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Router 333e9bb6-af7f-4e54-8e33-f669ec06856d has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:38.424503 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d52513-094d-4c62-9d8e-542d0acde141 req-852490cd-7849-49f7-9e2e-248ffc81fe5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:38.425202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d1d52513-094d-4c62-9d8e-542d0acde141 req-852490cd-7849-49f7-9e2e-248ffc81fe5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:38.446187 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-08e8cab5-ee0a-4ef8-91aa-9c6a03c830db tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:38.446848 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-08e8cab5-ee0a-4ef8-91aa-9c6a03c830db tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:38.527525 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-d1d52513-094d-4c62-9d8e-542d0acde141 req-852490cd-7849-49f7-9e2e-248ffc81fe5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:38.528721 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1d52513-094d-4c62-9d8e-542d0acde141 req-852490cd-7849-49f7-9e2e-248ffc81fe5c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.4452066 May 25 15:50:38.544343 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-08e8cab5-ee0a-4ef8-91aa-9c6a03c830db tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:38.545345 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-08e8cab5-ee0a-4ef8-91aa-9c6a03c830db tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 945 time: 0.4607537 May 25 15:50:38.654572 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d1d52513-094d-4c62-9d8e-542d0acde141 req-8ef4d5f3-28f3-45cd-8e4b-9267e99befff tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1111434 May 25 15:50:38.660626 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:38.680168 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Sync routers for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:38.692034 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:38.692729 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:38.731541 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-fee25780-31bd-4249-9160-072814ef8972 admin admin] 10.222.0.36 "PUT /v2.0/routers/333e9bb6-af7f-4e54-8e33-f669ec06856d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8427942 May 25 15:50:38.731904 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50684) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:38.882783 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:38.916216 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Deleting port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:38.916492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.007459 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.170485 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:50:37Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:39.174236 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Checking router: 333e9bb6-af7f-4e54-8e33-f669ec06856d for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:39.182936 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Routers {'333e9bb6-af7f-4e54-8e33-f669ec06856d'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:39.183551 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['333e9bb6-af7f-4e54-8e33-f669ec06856d'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:39.212055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] For port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:39.212418 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.345017 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling delete_port for 62e410a2-9c20-453a-864a-5ef7c5d2a2fd owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:39.358753 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.359552 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] Set router 333e9bb6-af7f-4e54-8e33-f669ec06856d gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:39.458045 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Deleting port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:39.458446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.619422 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.632773 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:39.659621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e', '6fd10c0b-7953-4682-8b93-6b38d31fbca5', '62e410a2-9c20-453a-864a-5ef7c5d2a2fd'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:50:39.803263 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:50:37Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:39.805216 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event deleted for resources: {'Port': ['ID=62e410a2-9c20-453a-864a-5ef7c5d2a2fd,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:39.811725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] For port a31ebfd2-e685-4d60-a02a-3c48be8a8d3e, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:39.811725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:39.817853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:39.818518 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffaea006-d013-4deb-aa13-bfb26e991539 None None] The sync data for ids ['333e9bb6-af7f-4e54-8e33-f669ec06856d'] in dv-cinder-791239-3-iscsi is: [{'id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'name': 'tempest-TestShelveInstance-1362224187-router', 'tenant_id': '9276d22c6df545f2a056d5059899b85f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39'}], 'enable_snat': True}, 'gw_port_id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:26Z', 'updated_at': '2021-05-25T15:50:37Z', 'revision_number': 5, 'project_id': '9276d22c6df545f2a056d5059899b85f', 'gw_port': {'id': 'a31ebfd2-e685-4d60-a02a-3c48be8a8d3e', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6e:16:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '333e9bb6-af7f-4e54-8e33-f669ec06856d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 457, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.39', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:27Z', 'updated_at': '2021-05-25T15:44:33Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:39.819560 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-90dae2e1-2810-4675-aeb8-15f94edaa5bc req-205fa603-fb87-4882-82d5-541bf6129ce9 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0 HTTP/1.1" status: 200 len: 210 time: 0.0537343 May 25 15:50:40.007738 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Calling delete_port for a31ebfd2-e685-4d60-a02a-3c48be8a8d3e owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:40.010981 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] No DVR routers for this DVR port 62e410a2-9c20-453a-864a-5ef7c5d2a2fd on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:40.015456 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.018268 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'name': 'network-vif-deleted', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:40.049147 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-0eb100e6-ecf2-46d1-b9fe-1c90fd755955 req-dddeeee1-14c4-4637-bcb3-0844a04eaa16 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "DELETE /v2.0/ports/62e410a2-9c20-453a-864a-5ef7c5d2a2fd HTTP/1.1" status: 204 len: 173 time: 1.4857528 May 25 15:50:40.071417 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7d7e5be4-9fd0-4c22-8889-ecc3a90fc9e0', 'name': 'network-vif-deleted', 'tag': '62e410a2-9c20-453a-864a-5ef7c5d2a2fd', 'status': 'completed', 'code': 200} May 25 15:50:40.184929 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50700) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:40.193586 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.203737 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-cdd0f0a3-bb38-4d1d-92f9-9feba76f4982 tempest-VolumesSnapshotTestJSON-665562847 tempest-VolumesSnapshotTestJSON-665562847-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.247007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Pushing event deleted for resources: {'Port': ['ID=a31ebfd2-e685-4d60-a02a-3c48be8a8d3e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:40.277992 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.321502 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.343250 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:40.347989 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.349441 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Usage tracker for resource:security_group_rule and tenant:12c6024a7ff644ec94731d054b2ccf63 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:40.352542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:40.358439 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:40.447018 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.451503 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.460416 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5a575b23-e438-479e-8a7a-78c1b7ecb67c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.499267 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=12c6024a7ff644ec94731d054b2ccf63&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3129888 May 25 15:50:40.501689 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77a0c9ce-de99-4172-80a0-a0da972ad508,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:40.505128 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50706) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:40.525150 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.525524 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.525910 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.526280 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.526641 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.526998 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.527350 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.527488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.527700 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.528076 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.528427 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.528776 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.529122 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.529467 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:40.534654 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.552307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.553036 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 333e9bb6-af7f-4e54-8e33-f669ec06856d {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:50:40.565351 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.566486 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] 10.222.0.36 "DELETE /v2.0/routers/333e9bb6-af7f-4e54-8e33-f669ec06856d HTTP/1.1" status: 204 len: 168 time: 1.8336911 May 25 15:50:40.569011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50710) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:40.591307 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.619202 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.634713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Deleting subnet ce334cf7-ad8f-4d17-8efa-939b870abd6d {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:50:40.637722 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.681185 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.686386 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d0f4b23b-65be-4219-a706-696d92687253 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:40.693055 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.700533 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77a0c9ce-de99-4172-80a0-a0da972ad508,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:40.703303 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:40.716704 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:40.720333 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/77a0c9ce-de99-4172-80a0-a0da972ad508 HTTP/1.1" status: 204 len: 168 time: 0.2118261 May 25 15:50:40.835801 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.134096 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.138372 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-72a3d3e5-57c2-4e2a-8c0e-a66deba089ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:41.179448 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ce334cf7-ad8f-4d17-8efa-939b870abd6d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:41.181388 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.184117 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:41.186669 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d4343f2-644a-4bf6-807f-88288f7703de None None] Network bef3b39e-4efb-47b6-ab09-ddc4c406ab32 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:41.191003 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-83559b40-8cf3-4a70-af9c-0d86df0345cc admin admin] 10.222.0.36 "DELETE /v2.0/subnets/ce334cf7-ad8f-4d17-8efa-939b870abd6d HTTP/1.1" status: 204 len: 168 time: 0.6180687 May 25 15:50:41.191270 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50722) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:41.297961 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.361393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d91560d0-d041-4797-a045-1a718afa8d68 req-d31bbc77-c6b2-4bcc-9f88-6093c81ad65b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:41.363316 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d91560d0-d041-4797-a045-1a718afa8d68 req-d31bbc77-c6b2-4bcc-9f88-6093c81ad65b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.0847876 May 25 15:50:41.374881 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Deleting port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:41.375444 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.420978 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-d91560d0-d041-4797-a045-1a718afa8d68 req-90216e1f-23e8-454b-a760-c99a458abbe4 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503802 May 25 15:50:41.454912 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] DHCP port deletion for bef3b39e-4efb-47b6-ab09-ddc4c406ab32 request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:50:41.526990 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Deleting port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:41.527515 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.580284 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] For port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:41.580667 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.590557 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:41.655891 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62e410a2-9c20-453a-864a-5ef7c5d2a2fd no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:41.704468 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Calling delete_port for 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd owned by network:dhcp {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:41.708818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 62e410a2-9c20-453a-864a-5ef7c5d2a2fd {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:41.709170 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 62e410a2-9c20-453a-864a-5ef7c5d2a2fd not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:41.713427 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] For port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,segment=NetworkSegment(bb2550ff-05c6-4e65-a727-67a511075e2d),segment_id=bb2550ff-05c6-4e65-a727-67a511075e2d)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:41.713824 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.751583 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.755194 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5762f2c2-3af1-4fa8-84d7-205af273c4fa tempest-TestMinimumBasicScenario-1913321032 tempest-TestMinimumBasicScenario-1913321032-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:41.796515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Pushing event deleted for resources: {'Port': ['ID=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:41.800597 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:41.804033 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] No DVR routers for this DVR port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd on host dv-cinder-791239-3-iscsi {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:41.833919 dv-cinder-791239-3-iscsi neutron-server[98464]: INFO neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No ports have port_id starting with 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd May 25 15:50:41.840573 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Calling delete_port for 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:41.843064 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 462d06b3-a029-444b-bf67-dda89e9f0a73 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:41.881809 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 462d06b3-a029-444b-bf67-dda89e9f0a73 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:41.882160 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 462d06b3-a029-444b-bf67-dda89e9f0a73 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:41.882581 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device a31ebfd2-e685-4d60-a02a-3c48be8a8d3e no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:41.916791 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: a31ebfd2-e685-4d60-a02a-3c48be8a8d3e {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:41.917058 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device a31ebfd2-e685-4d60-a02a-3c48be8a8d3e not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:41.920235 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.933515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bef3b39e-4efb-47b6-ab09-ddc4c406ab32']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:41.949544 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bb2550ff-05c6-4e65-a727-67a511075e2d') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:41.949842 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bb2550ff-05c6-4e65-a727-67a511075e2d') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:41.953265 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.958119 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:41.962014 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.978600 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.984560 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Releasing vlan 358 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:50:41.984971 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:50:41.998033 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:50:42.000235 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Pushing event deleted for resources: {'Port': ['ID=98a5ce70-6d5e-4cc7-83ca-522a54fff8cd,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:42.002386 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] No DVR routers for this DVR port 98a5ce70-6d5e-4cc7-83ca-522a54fff8cd on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:42.015103 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.015299 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.015630 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.016062 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.016389 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.016987 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.017276 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.017607 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.017902 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.018777 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.019054 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.019368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:50:42.022251 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-49b1294b-76bb-453b-bea2-e9c1a5a40e4f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:42.073662 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:42.077243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d61c42bb-1469-4a93-8556-d5d26210a7eb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:42.090189 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:42.104442 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Pushing event deleted for resources: {'Network': ['ID=bef3b39e-4efb-47b6-ab09-ddc4c406ab32,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:42.107499 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:42.117887 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a8966c01-d28c-4604-92c4-ba5875173123 admin admin] 10.222.0.36 "DELETE /v2.0/networks/bef3b39e-4efb-47b6-ab09-ddc4c406ab32 HTTP/1.1" status: 204 len: 168 time: 0.9256709 May 25 15:50:42.120830 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50726) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:42.650484 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc req-53370c26-8296-4457-9a27-670f4209da17 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:42.651200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc req-53370c26-8296-4457-9a27-670f4209da17 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:42.698135 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:42.707492 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc req-53370c26-8296-4457-9a27-670f4209da17 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:42.708619 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc req-53370c26-8296-4457-9a27-670f4209da17 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.1685824 May 25 15:50:42.768568 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-bc5b52dc-94d1-4028-bbbb-5ac3a56679bc req-47e431b9-e398-42cf-8ecc-a38b7ce1230e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525284 May 25 15:50:42.772196 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:43.264029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Deleting port 3653baa1-04ab-4037-9279-36fa2a5f66e1 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:43.264371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:43.439932 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] For port 3653baa1-04ab-4037-9279-36fa2a5f66e1, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=3653baa1-04ab-4037-9279-36fa2a5f66e1,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:43.440853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:43.465314 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-45878a96-a400-413e-9207-a5731898463b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.466692 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-45878a96-a400-413e-9207-a5731898463b tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.1410067 May 25 15:50:43.602810 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Calling delete_port for 3653baa1-04ab-4037-9279-36fa2a5f66e1 owned by network:router_interface {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:43.737954 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Deleting port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:43.738542 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:43.894922 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] For port 6fd10c0b-7953-4682-8b93-6b38d31fbca5, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=6fd10c0b-7953-4682-8b93-6b38d31fbca5,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:43.895200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:43.954147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd030d94-6973-4deb-afb1-0b0587e3ee3a req-b25f9769-bf7e-434c-98a3-145fa80027f5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:43.956383 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd030d94-6973-4deb-afb1-0b0587e3ee3a req-b25f9769-bf7e-434c-98a3-145fa80027f5 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 945 time: 0.0814116 May 25 15:50:43.999726 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bd030d94-6973-4deb-afb1-0b0587e3ee3a req-6fa0da45-0361-48ee-a5c5-01cfc1b4b00e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376215 May 25 15:50:44.056745 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling delete_port for 6fd10c0b-7953-4682-8b93-6b38d31fbca5 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:44.089838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:44.095207 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8c709ef3-8d5e-44dc-946a-3354248721af tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:44.142481 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Pushing event deleted for resources: {'Port': ['ID=3653baa1-04ab-4037-9279-36fa2a5f66e1,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:44.172165 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:44.536662 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:44.550292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e', '6fd10c0b-7953-4682-8b93-6b38d31fbca5'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:50:44.557528 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d7dfd9cb-83ca-44bc-83ea-6c9a47011bee tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:44.609323 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event deleted for resources: {'Port': ['ID=6fd10c0b-7953-4682-8b93-6b38d31fbca5,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:44.611707 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:44.693478 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] No DVR routers for this DVR port 6fd10c0b-7953-4682-8b93-6b38d31fbca5 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:44.695914 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:44.699830 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'name': 'network-vif-deleted', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:44.704084 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:44.784458 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c381c82c-5123-4915-b9b2-8f65b8ffaf9b', 'name': 'network-vif-deleted', 'tag': '6fd10c0b-7953-4682-8b93-6b38d31fbca5', 'status': 'completed', 'code': 200} May 25 15:50:44.793526 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-35fec76b-227d-4912-b8d8-a23af12f1846 req-0581106b-0348-4972-8ad9-aa8ba12dd13a tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "DELETE /v2.0/ports/6fd10c0b-7953-4682-8b93-6b38d31fbca5 HTTP/1.1" status: 204 len: 173 time: 1.2781303 May 25 15:50:45.084751 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Router 4af4a15f-6847-4985-8c5c-e2467f1831b2 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:50:45.168365 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-ed8892b8-f0e9-478a-ac9b-22d1a64fbed7 req-91566d16-b081-46b3-9c1d-4503c1710b77 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=c381c82c-5123-4915-b9b2-8f65b8ffaf9b HTTP/1.1" status: 200 len: 210 time: 0.0468185 May 25 15:50:45.266410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:50:45.271434 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] 10.222.0.36 "PUT /v2.0/routers/4af4a15f-6847-4985-8c5c-e2467f1831b2/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1496651 May 25 15:50:45.274014 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50738) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:45.276847 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Sync routers for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:50:45.287289 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:45.287925 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:45.450712 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:45.468909 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:45.631341 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:45.703397 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Deleting port 5f37aeac-39b6-49c9-aee9-e8ce768bb421 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:45.703737 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:45.755016 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43'}], 'enable_snat': True}, 'gw_port_id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:50:43Z', 'revision_number': 5, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port': {'id': '5f37aeac-39b6-49c9-aee9-e8ce768bb421', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:2f:f4:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'device_owner': 'network:router_gateway', 'standard_attr_id': 469, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.43', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:44:34Z', 'updated_at': '2021-05-25T15:44:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:45.759388 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Checking router: 4af4a15f-6847-4985-8c5c-e2467f1831b2 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:50:45.768844 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Routers {'4af4a15f-6847-4985-8c5c-e2467f1831b2'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:50:45.769476 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:50:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['4af4a15f-6847-4985-8c5c-e2467f1831b2'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:45.925687 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] Set router 4af4a15f-6847-4985-8c5c-e2467f1831b2 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:50:45.938539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] For port 5f37aeac-39b6-49c9-aee9-e8ce768bb421, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=5f37aeac-39b6-49c9-aee9-e8ce768bb421,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:45.939065 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.029017 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:50:45Z', 'revision_number': 6, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:46.032938 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b1edd7e-9de7-4a60-9c82-dca3a73f1f94 None None] The sync data for ids ['4af4a15f-6847-4985-8c5c-e2467f1831b2'] in dv-cinder-791239-3-iscsi is: [{'id': '4af4a15f-6847-4985-8c5c-e2467f1831b2', 'name': 'tempest-TestShelveInstance-1692893011-router', 'tenant_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:44:33Z', 'updated_at': '2021-05-25T15:50:45Z', 'revision_number': 6, 'project_id': '4d92794aeb894cfd99077fb5ebd9b29e', 'gw_port_host': None}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:50:46.070678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Calling delete_port for 5f37aeac-39b6-49c9-aee9-e8ce768bb421 owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:46.204988 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.208831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f4a0a36d-6502-4c4e-aebb-efb40e154d2e service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:46.257719 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Pushing event deleted for resources: {'Port': ['ID=5f37aeac-39b6-49c9-aee9-e8ce768bb421,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:46.260837 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:46.351766 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.535457 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.537685 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.561693 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.562496 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4af4a15f-6847-4985-8c5c-e2467f1831b2 {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:50:46.575300 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.578835 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-a7d65143-6d59-4bbf-b6a1-5edefa273b99 admin admin] 10.222.0.36 "DELETE /v2.0/routers/4af4a15f-6847-4985-8c5c-e2467f1831b2 HTTP/1.1" status: 204 len: 168 time: 1.3014863 May 25 15:50:46.579074 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50750) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:46.640996 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Deleting subnet c1a27ea4-f8a7-4d92-acd2-417c203ea7b2 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:50:46.644891 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.692754 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:46.776955 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.028745 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.032853 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.072050 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c1a27ea4-f8a7-4d92-acd2-417c203ea7b2,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:47.074908 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.075968 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.084340 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-223e3408-1fc5-40e1-bcce-5a5b8d08cbd0 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/c1a27ea4-f8a7-4d92-acd2-417c203ea7b2 HTTP/1.1" status: 204 len: 168 time: 0.5025904 May 25 15:50:47.085797 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50754) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:47.087415 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a6164ad2-b22d-473e-826b-7efa2e79da16 None None] Network 89cbf153-f088-4f8c-8165-498b7d56e2fd requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:50:47.187500 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.267997 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Deleting port ff2be4fa-3221-4970-8775-712ce1d7b2db {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:47.268374 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.335818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] DHCP port deletion for 89cbf153-f088-4f8c-8165-498b7d56e2fd request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:50:47.371354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.db [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] For port ff2be4fa-3221-4970-8775-712ce1d7b2db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ff2be4fa-3221-4970-8775-712ce1d7b2db,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98463) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:47.371732 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.398817 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Deleting port ff2be4fa-3221-4970-8775-712ce1d7b2db {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:47.399204 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.535447 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 5f37aeac-39b6-49c9-aee9-e8ce768bb421 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:47.574176 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 5f37aeac-39b6-49c9-aee9-e8ce768bb421 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:47.574527 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 5f37aeac-39b6-49c9-aee9-e8ce768bb421 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:47.575143 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ff2be4fa-3221-4970-8775-712ce1d7b2db no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:47.595610 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Calling delete_port for ff2be4fa-3221-4970-8775-712ce1d7b2db owned by network:dhcp {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:47.627748 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] For port ff2be4fa-3221-4970-8775-712ce1d7b2db, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=ff2be4fa-3221-4970-8775-712ce1d7b2db,segment=NetworkSegment(56c9b3b5-cb9c-4287-8c22-43adc9b03d9e),segment_id=56c9b3b5-cb9c-4287-8c22-43adc9b03d9e)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:47.628176 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.647663 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.652320 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-04a19500-edb4-49e2-9bea-b460bdcab78f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.696101 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6fd10c0b-7953-4682-8b93-6b38d31fbca5 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:47.699566 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] No DVR routers for this DVR port ff2be4fa-3221-4970-8775-712ce1d7b2db on host dv-cinder-791239-3-iscsi {{(pid=98463) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:47.701182 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=ff2be4fa-3221-4970-8775-712ce1d7b2db,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:47.727853 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.795110 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Calling delete_port for ff2be4fa-3221-4970-8775-712ce1d7b2db owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:47.797311 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 6fd10c0b-7953-4682-8b93-6b38d31fbca5 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:47.797664 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 6fd10c0b-7953-4682-8b93-6b38d31fbca5 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:47.810292 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No active binding found for port ff2be4fa-3221-4970-8775-712ce1d7b2db {{(pid=98464) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 25 15:50:47.810712 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device ff2be4fa-3221-4970-8775-712ce1d7b2db not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:47.811156 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3653baa1-04ab-4037-9279-36fa2a5f66e1 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:47.821186 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.835109 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['89cbf153-f088-4f8c-8165-498b7d56e2fd']}} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:47.850246 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 3653baa1-04ab-4037-9279-36fa2a5f66e1 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:47.850621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 3653baa1-04ab-4037-9279-36fa2a5f66e1 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:47.851966 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e') {'for_net_delete': True} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:47.852324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.services.segments.db [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '56c9b3b5-cb9c-4287-8c22-43adc9b03d9e') {} {{(pid=98463) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:47.881922 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.885731 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:47.887827 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10571797'] for segment, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.905691 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.912721 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Releasing vlan 355 on physical network physnet1 to pool {{(pid=98463) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:50:47.913105 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1839689'] for segment, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: Traceback (most recent call last): May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: timer() May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: cb(*args, **kw) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: return func(*args, **kwargs) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: self._notify() May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: self.callback(batched_events) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: event.method(event) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: return f(self, *a, **k) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._get(url).json() May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: return self.request(url, 'GET', **kwargs) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:50:47.926115 dv-cinder-791239-3-iscsi neutron-server[98463]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:50:47.930202 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Pushing event deleted for resources: {'Port': ['ID=ff2be4fa-3221-4970-8775-712ce1d7b2db,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:47.933201 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:47.934002 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de85eda9-db23-4b67-beb7-74fdc2060944 None None] No DVR routers for this DVR port ff2be4fa-3221-4970-8775-712ce1d7b2db on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:48.005087 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.008478 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:48.022909 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.036423 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Pushing event deleted for resources: {'Network': ['ID=89cbf153-f088-4f8c-8165-498b7d56e2fd,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:48.041121 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:48.056055 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-1db70c41-26ca-4fe7-a6eb-ced9ca1667b2 admin admin] 10.222.0.36 "DELETE /v2.0/networks/89cbf153-f088-4f8c-8165-498b7d56e2fd HTTP/1.1" status: 204 len: 168 time: 0.9669712 May 25 15:50:48.077941 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 req-6694d29d-17fc-4c31-ae2f-8700c1ead338 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:48.078878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 req-6694d29d-17fc-4c31-ae2f-8700c1ead338 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:48.096049 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 req-6694d29d-17fc-4c31-ae2f-8700c1ead338 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:48.097819 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 req-6694d29d-17fc-4c31-ae2f-8700c1ead338 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 945 time: 0.1182847 May 25 15:50:48.144000 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-00dbb5b8-42d0-48e6-bbfc-f22a9e4197b1 req-0ef48146-8bad-43b2-a8aa-27be1e9387ee tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396352 May 25 15:50:48.238031 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50766) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:48.287442 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-11108c33-fec5-4693-b11d-4d49525fe355 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=9276d22c6df545f2a056d5059899b85f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0481372 May 25 15:50:48.289742 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50770) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:48.345857 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.370846 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.431300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.436130 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6309be44-065d-4ff0-9325-48c0b02a9ce2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:48.449433 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=076fd7c9-a1ff-4e1a-bf26-5c48af0e8380,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:48.456396 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:48.457632 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.458712 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-29073961-4ff4-4ce7-b764-494821857f2b admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/076fd7c9-a1ff-4e1a-bf26-5c48af0e8380 HTTP/1.1" status: 204 len: 168 time: 0.1680701 May 25 15:50:48.804859 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50778) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:48.852141 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-4015823a-a360-4639-bea9-ffbfe14dd12a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=4d92794aeb894cfd99077fb5ebd9b29e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0460663 May 25 15:50:48.854469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50782) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:48.911756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.936851 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.991488 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:48.995345 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-70afc4a5-38e8-44f3-8ad3-a956c96435de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:49.006645 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26552406-b235-449f-b0e2-e0db8415da06,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:49.010452 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:49.013606 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:49.014705 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/26552406-b235-449f-b0e2-e0db8415da06 HTTP/1.1" status: 204 len: 168 time: 0.1593783 May 25 15:50:49.364232 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 req-1a474a82-d948-451b-86fd-6abe50a66a0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:49.365829 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 req-1a474a82-d948-451b-86fd-6abe50a66a0e tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 945 time: 0.0956197 May 25 15:50:49.412975 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-6bcaf14a-8fc3-47c2-8c83-b009ae5fdab7 req-d272af03-192e-40ec-850f-3916f3dbc6e1 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/security-groups?id=4539e613-a058-44ef-948a-29f99a8a94d7&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411816 May 25 15:50:49.737559 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-3d0f100f-1b6f-4830-9aa3-a11f6f42b6ba tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:50:49.738991 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-3d0f100f-1b6f-4830-9aa3-a11f6f42b6ba tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 945 time: 0.0822766 May 25 15:50:49.964016 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Deleting port 03200337-3a8d-470d-b921-cf873c06c54e {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:50:49.964358 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:50.096833 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] For port 03200337-3a8d-470d-b921-cf873c06c54e, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=03200337-3a8d-470d-b921-cf873c06c54e,segment=NetworkSegment(2cf525b3-654f-4720-8254-63dec3a85366),segment_id=2cf525b3-654f-4720-8254-63dec3a85366)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:50:50.097050 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:50.217942 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Calling delete_port for 03200337-3a8d-470d-b921-cf873c06c54e owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:50:50.332922 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:50.338728 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7021dec4-33f1-4074-9cef-19cb639940ab tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:50.346749 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] get_ports_and_sgs() called for port_ids ['03200337-3a8d-470d-b921-cf873c06c54e'] {{(pid=98464) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 15:50:50.385446 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Pushing event deleted for resources: {'Port': ['ID=03200337-3a8d-470d-b921-cf873c06c54e,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:50.388838 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:50.460079 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] No DVR routers for this DVR port 03200337-3a8d-470d-b921-cf873c06c54e on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:50:50.462415 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:50.464985 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'name': 'network-vif-deleted', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:50:50.480473 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-9cbe6d23-ac73-4638-8a3e-fc863d96bdea req-1564d3c4-8518-4c5a-99f1-5011d0a3e8a3 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.70 "DELETE /v2.0/ports/03200337-3a8d-470d-b921-cf873c06c54e HTTP/1.1" status: 204 len: 173 time: 0.7343230 May 25 15:50:50.518771 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fef24ea0-a934-410a-8440-614ba104efd6', 'name': 'network-vif-deleted', 'tag': '03200337-3a8d-470d-b921-cf873c06c54e', 'status': 'completed', 'code': 200} May 25 15:50:50.566463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 req-db9f0173-c868-4b67-a97d-c45ea7f4ccfc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Synchronizing usage tracker for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:50:50.581550 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 req-db9f0173-c868-4b67-a97d-c45ea7f4ccfc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Unset dirty status for tenant:6e1f97f6101d466a9c224075352387d8 on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:50:50.582758 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-ca8f5bfb-1592-40d7-be1d-dd0f1156ab14 req-db9f0173-c868-4b67-a97d-c45ea7f4ccfc tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] 10.222.0.36 "GET /v2.0/ports?device_id=fef24ea0-a934-410a-8440-614ba104efd6 HTTP/1.1" status: 200 len: 210 time: 0.0620117 May 25 15:50:51.680356 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50796) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:51.740216 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Deleting subnet cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:50:51.743048 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.792396 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:51.850749 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.090362 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.095122 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:52.133767 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.137456 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:52.139646 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:52.142774 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-27959d9a-4ad2-4aa0-bb68-cdefefd3c154 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/cd619ecc-9a79-4fdd-9e8d-1deaa5e31c93 HTTP/1.1" status: 204 len: 168 time: 0.4614322 May 25 15:50:52.145970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50800) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:52.250058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.372163 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.385056 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['247feda9-7b6d-4c87-abaf-0b9c5d89f2d3']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:52.397713 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2cf525b3-654f-4720-8254-63dec3a85366') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:52.398010 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2cf525b3-654f-4720-8254-63dec3a85366') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:50:52.410135 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.426019 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.432029 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Releasing vlan 350 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:50:52.432407 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:50:52.445688 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:50:52.521475 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.525136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:52.537316 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.547073 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Pushing event deleted for resources: {'Network': ['ID=247feda9-7b6d-4c87-abaf-0b9c5d89f2d3,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:52.550741 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:52.556328 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-b8c17ef7-6e8f-4851-bed3-2e01e31fa79e admin admin] 10.222.0.36 "DELETE /v2.0/networks/247feda9-7b6d-4c87-abaf-0b9c5d89f2d3 HTTP/1.1" status: 204 len: 168 time: 0.4092641 May 25 15:50:52.724847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50806) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:52.773035 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-ef918279-8656-48f7-886d-9d2371f5421a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=6e1f97f6101d466a9c224075352387d8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0468597 May 25 15:50:52.775263 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 50810) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:52.832033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.858877 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.913099 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.916857 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-81ab65d4-7eb7-4ca2-a2ad-a30d09fe0933 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:52.930718 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4539e613-a058-44ef-948a-29f99a8a94d7,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:52.933268 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:52.940397 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:52.941501 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-84b68d23-5f49-4ea1-b2be-bc9ddcc58920 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/4539e613-a058-44ef-948a-29f99a8a94d7 HTTP/1.1" status: 204 len: 168 time: 0.1653242 May 25 15:50:53.707341 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 03200337-3a8d-470d-b921-cf873c06c54e no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:50:53.740670 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 03200337-3a8d-470d-b921-cf873c06c54e {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:50:53.741021 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 03200337-3a8d-470d-b921-cf873c06c54e not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:50:54.324447 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50862) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:54.439878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.453781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:50:54.457575 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Usage tracker for resource:security_group_rule and tenant:43389cf9a35d414893a7a9312a56b96f is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:50:54.460319 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:50:54.466047 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:50:54.546409 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.550682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.558626 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c3f81c20-f4d6-42b8-80aa-68f1b1a82da3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:54.600111 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=712586e4-c090-4b06-8b13-a6966b2bfce1,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:54.605383 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=43389cf9a35d414893a7a9312a56b96f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2787383 May 25 15:50:54.605383 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-78f1de2e-384b-40b9-9253-a0954f6644b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:54.606848 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 50868) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:50:54.746970 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.771982 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.827025 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.831219 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-89c02607-66bf-45fe-a85c-1a3ce82d044d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:50:54.842000 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=712586e4-c090-4b06-8b13-a6966b2bfce1,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:50:54.845426 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:50:54.849230 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:50:54.850349 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-78be6433-3650-4180-8faa-1d014f3fce8e admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/712586e4-c090-4b06-8b13-a6966b2bfce1 HTTP/1.1" status: 204 len: 168 time: 0.2426159 May 25 15:50:59.979794 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d0ba83da-0503-488a-b632-f76ea2ca6ddd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.644847 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:02.702945 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-00bcf324-5b32-4631-95f6-a6db0488f902 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:03.481315 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:05.202368 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:11.667820 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:51:12.685313 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51084) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:12.704011 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.804271 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.818482 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:12.822635 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Usage tracker for resource:security_group_rule and tenant:067dcddaf03e4812b54d9885f05dff48 is out of sync, need to count used quota {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:12.825416 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98462) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:12.831602 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.quota.driver [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98462) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:12.913977 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.917878 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:12.929898 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-27fd09de-470a-48be-af0a-4b4c9b99b1a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:12.969062 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=067dcddaf03e4812b54d9885f05dff48&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2827406 May 25 15:51:12.970013 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb2666ad-ad23-4a36-b536-52556e503db5,revision_number=1']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:12.971828 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51090) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:12.973413 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:13.029448 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.055180 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.108366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.111782 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-bee520eb-d1d0-4614-b1a2-f76dbd7f973f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:13.122756 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb2666ad-ad23-4a36-b536-52556e503db5,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:13.126499 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:13.129612 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.130947 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/eb2666ad-ad23-4a36-b536-52556e503db5 HTTP/1.1" status: 204 len: 168 time: 0.1578093 May 25 15:51:13.404660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51098) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:13.422681 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.436649 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:13.440407 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Usage tracker for resource:security_group_rule and tenant:8acc0c803469494da0fddc35d3f3b349 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:13.443205 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:13.449006 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:13.535422 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.539174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.545745 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-03648e7f-8723-4ab3-b181-5ee4a5af642e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:13.586326 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=8acc0c803469494da0fddc35d3f3b349&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1804733 May 25 15:51:13.587233 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6ac6da3-a8a4-4262-9877-785290da9611,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:13.589064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51102) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:13.590277 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5880d034-30e8-418e-bda2-97c18572386c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:13.647844 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.675082 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.725770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.729509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e22cbfd5-06a0-486e-b7d5-c722ace53270 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:13.741574 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6ac6da3-a8a4-4262-9877-785290da9611,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:13.744215 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:13.752943 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:13.754072 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/c6ac6da3-a8a4-4262-9877-785290da9611 HTTP/1.1" status: 204 len: 168 time: 0.1640356 May 25 15:51:16.432291 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51172) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:16.546623 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.560857 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:16.564472 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Usage tracker for resource:security_group_rule and tenant:193c88f08c8d4c3ca7cd6900984900bb is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:16.567829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:16.573499 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:16.651554 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.655171 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.662984 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-4b6b846e-b79f-4972-be6f-bebc8dbc8547 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:16.701283 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=193c88f08c8d4c3ca7cd6900984900bb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2679787 May 25 15:51:16.702244 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7abf80bb-a42c-439d-ac7d-36bbc18b9237,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:16.704011 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51178) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:16.705364 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-def5609d-9acd-426d-824b-1b1356536ad9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:16.764981 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.790249 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.840659 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.844206 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-502ddcca-d2cd-4ace-8522-27fa19b2423a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:16.856916 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7abf80bb-a42c-439d-ac7d-36bbc18b9237,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:16.859207 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:16.863110 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:16.866548 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-7524f710-7964-4c33-b043-12641b86ea0c admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/7abf80bb-a42c-439d-ac7d-36bbc18b9237 HTTP/1.1" status: 204 len: 168 time: 0.1590631 May 25 15:51:17.139584 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51186) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:17.162366 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.176005 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:17.179794 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Usage tracker for resource:security_group_rule and tenant:94543c82cb3b46d69971e7ca121bbdae is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:17.182591 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:17.188198 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:17.267061 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.271471 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.279632 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-30c07d1b-4ee1-4226-8f81-0a496e201f7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:17.317883 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=94543c82cb3b46d69971e7ca121bbdae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1772184 May 25 15:51:17.319628 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0450b680-b015-4480-ab37-c1cfa6ca11c8,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:17.320584 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51190) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:17.323005 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-8cff77f2-07f0-4c30-a816-5a6b6b3b7fdb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:17.380817 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.407306 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.459489 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.463020 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c1d24880-c977-4164-a1be-b020acd841cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:17.474166 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0450b680-b015-4480-ab37-c1cfa6ca11c8,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:17.478350 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:17.481547 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:17.482730 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/0450b680-b015-4480-ab37-c1cfa6ca11c8 HTTP/1.1" status: 204 len: 168 time: 0.1611848 May 25 15:51:17.910631 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-f585383e-ffe9-401b-897f-38a898ab7fcb service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0834618 May 25 15:51:18.013283 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-5882574a-91eb-4386-8de5-684e3e79d5c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:18.014840 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-5882574a-91eb-4386-8de5-684e3e79d5c8 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1099 time: 0.0798602 May 25 15:51:18.172053 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-9dc1c3d0-1e32-4e54-8386-912731570e52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:18.173440 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-9dc1c3d0-1e32-4e54-8386-912731570e52 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1355424 May 25 15:51:18.285831 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-b5bfbc95-97a4-423b-b34f-354bf7ade1f3 service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 1001 time: 0.1045363 May 25 15:51:18.372507 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-87f23f62-b0a2-41a7-9aa9-3c3463742c0e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:18.373999 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-87f23f62-b0a2-41a7-9aa9-3c3463742c0e service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0795498 May 25 15:51:18.462210 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-8ddb52eb-cf4e-4ddf-92f1-67aaf55cf1ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:51:18.463742 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-8ddb52eb-cf4e-4ddf-92f1-67aaf55cf1ee service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0802412 May 25 15:51:18.621073 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-32a4b597-031f-4a1a-ad28-c2a8dfc6f1fd service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1497262 May 25 15:51:18.662542 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51222) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:18.756753 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-1b371e51-24f7-46f9-b0cb-66988baf8fb4 req-9f615657-9631-44d5-8f6e-7aa5bbcff83b service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1277883 May 25 15:51:18.781905 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:18.796410 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:18.800122 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Usage tracker for resource:security_group_rule and tenant:a08dd1cc4f9647768304bb17db4c0b3a is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:18.802809 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:18.808514 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:18.890128 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:18.895055 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:18.901868 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-b185d9e8-495d-4521-ad58-5eeb582b205d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:18.944372 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88e0f14a-cba6-4945-bc54-d5c62d2df1f6,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:18.948592 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=a08dd1cc4f9647768304bb17db4c0b3a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2850020 May 25 15:51:18.949559 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-96cd086b-e283-4e22-9896-897f9aa4896e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:18.952137 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51228) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:19.009322 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:19.034934 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:19.084829 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:19.089675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-eac3f889-92df-46cc-a0b8-c70050727b9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:19.104410 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88e0f14a-cba6-4945-bc54-d5c62d2df1f6,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:19.106953 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:19.119385 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:19.120530 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-688d4282-fb28-4a84-8d91-545fc36019ff admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/88e0f14a-cba6-4945-bc54-d5c62d2df1f6 HTTP/1.1" status: 204 len: 168 time: 0.1683919 May 25 15:51:29.981776 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b7a2f027-034f-4bb0-b4fe-0a0ec401f619 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:32.647104 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:32.694707 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3230ec2c-d98c-4378-8e85-e5acb79c4c0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:33.480221 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:35.200558 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:42.711746 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.249980 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51364) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:43.364437 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.378876 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:51:43.382675 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Usage tracker for resource:security_group_rule and tenant:515d629d1cb946b38d3754c5407123c3 is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:51:43.385481 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:51:43.391112 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:51:43.488044 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.492010 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.499300 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c52fa1b4-d1d9-4344-96bd-fbbe4afbbe88 tempest-AttachVolumeShelveTestJSON-1373324681 tempest-AttachVolumeShelveTestJSON-1373324681-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:43.541175 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=515d629d1cb946b38d3754c5407123c3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2901402 May 25 15:51:43.542075 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1dba291-8a1c-436e-a584-a201465dd00c,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:43.543910 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51370) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:51:43.549559 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.550469 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.550847 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.551218 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.551588 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.551987 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.552354 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.552862 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.553231 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.553597 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.553960 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.554318 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98463) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.558283 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-f8aff85f-623e-4f8d-817e-f74e690de27a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:43.600830 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.626131 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.684615 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.688100 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-523ab343-791a-45be-adf1-103947ad409c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:51:43.699012 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1dba291-8a1c-436e-a584-a201465dd00c,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:51:43.709333 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.709700 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.710058 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.710411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.710757 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.711105 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.711451 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.711793 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.712161 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.712509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.712850 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.713186 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98462) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:51:43.716190 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:51:43.717268 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/b1dba291-8a1c-436e-a584-a201465dd00c HTTP/1.1" status: 204 len: 168 time: 0.1723921 May 25 15:51:43.718110 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6f369dd7-1101-464c-9ceb-583bd1d500cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:51:48.667625 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:51:59.984167 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3cfb447e-f533-4b9f-ab8c-17480f5a2e02 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:02.649698 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:02.695842 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f2867119-7771-4b42-b258-55bc70c50a41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:03.483776 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:05.203223 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:12.692177 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51574) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:12.738085 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.052513 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port 9df71888-92f1-4abd-9f77-68fd45f6110a {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:13.052852 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.172957 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.173280 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.298870 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for 9df71888-92f1-4abd-9f77-68fd45f6110a owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:13.423324 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.426934 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-191e6449-2459-42cd-b373-ededb08e1566 tempest-TestShelveInstance-1026451203 tempest-TestShelveInstance-1026451203-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:13.470946 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=9df71888-92f1-4abd-9f77-68fd45f6110a,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:13.473660 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:13.567429 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:13.567751 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP 6a0eb770-91b6-4651-911e-53ffd82a35c4 disassociated (deleted). External IP: 172.27.0.14, port: b62764e4-ba3e-4187-9554-db7555c582f2. May 25 15:52:13.921685 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:52:14.103463 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:52:14.113780 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:52:14.125386 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:14.126293 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:14.135166 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:14.192604 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-c87a7348-74fe-454e-8b35-548a5aaa0c0c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /v2.0/floatingips/6a0eb770-91b6-4651-911e-53ffd82a35c4 HTTP/1.1" status: 204 len: 168 time: 1.4993286 May 25 15:52:14.194209 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:52:14.320184 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:14.378908 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'status': 'completed', 'code': 200} May 25 15:52:14.490770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-30f62f37-d563-4413-b90e-4374d0c13e91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:14.492312 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-30f62f37-d563-4413-b90e-4374d0c13e91 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 1098 time: 0.0823736 May 25 15:52:14.611677 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 req-2b7b876b-7a4f-4271-a2d3-cb96da05af8b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:14.612393 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 req-2b7b876b-7a4f-4271-a2d3-cb96da05af8b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:52:14.628928 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 req-2b7b876b-7a4f-4271-a2d3-cb96da05af8b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:52:14.630021 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 req-2b7b876b-7a4f-4271-a2d3-cb96da05af8b tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.1129475 May 25 15:52:14.642375 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b2f5f05d-2710-4895-abc3-d7fd4361ff08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:14.644156 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-b2f5f05d-2710-4895-abc3-d7fd4361ff08 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.1400566 May 25 15:52:14.738285 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:14.744614 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:52:14.757795 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:14.758506 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:14.811456 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-e2ffe7d3-20ad-4fd8-95ea-c61096713ca3 req-350be094-86c4-4d99-92df-833817849b1c tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1739028 May 25 15:52:14.815450 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-951787b2-305d-4237-9f3f-2546fb52e36f service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 200 len: 217 time: 0.1623404 May 25 15:52:14.882963 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-0c426899-f745-43ee-b82e-377633a30f91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:14.884438 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-0c426899-f745-43ee-b82e-377633a30f91 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0604799 May 25 15:52:14.951922 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:14.972421 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-220e11b2-1eb1-4368-bcb1-566dd87ce87e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:14.973973 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-220e11b2-1eb1-4368-bcb1-566dd87ce87e service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0823052 May 25 15:52:15.114130 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-68cf1e86-015e-42f2-8c82-c9230e22254f service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1289721 May 25 15:52:15.251958 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-c52b4fd0-78ee-48cd-aa0a-edb41ad99531 req-02a3118e-93e4-417f-a87e-2be2de0b0d28 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1304352 May 25 15:52:15.302816 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:15.307389 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-811d2890-0319-473a-a24d-11769ef79d80 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_floatingips': [{'id': '87abb731-2ba6-407d-b27b-3addb54ec28c', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'floating_ip_address': '172.27.0.89', 'floating_network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'router_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'port_id': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 565, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'mac_address': 'fa:16:3e:05:b5:f8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T15:47:32Z', 'updated_at': '2021-05-25T15:47:35Z', 'revision_number': 1, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:52:15.509456 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bf0102b1-30e2-4f3c-acdc-ba18c2be0a12 None None] New status for floating IP 6a0eb770-91b6-4651-911e-53ffd82a35c4: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:52:16.029156 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec req-de09bcb9-e7ce-4ac1-81f1-761970f9962e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:16.030642 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec req-de09bcb9-e7ce-4ac1-81f1-761970f9962e tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0804796 May 25 15:52:16.075083 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-b01d9cd9-e509-4c48-8b70-0e63b1cdddec req-39811d8a-3ac3-48d0-8d7b-e8b37761ffc6 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384645 May 25 15:52:16.581731 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-a5629fa2-1c79-4152-bb2d-1da822722771 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:16.583173 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-a5629fa2-1c79-4152-bb2d-1da822722771 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 945 time: 0.0810843 May 25 15:52:16.715781 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port b62764e4-ba3e-4187-9554-db7555c582f2 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:16.716141 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:16.850927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] For port b62764e4-ba3e-4187-9554-db7555c582f2, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=b62764e4-ba3e-4187-9554-db7555c582f2,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:16.851223 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:16.971401 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for b62764e4-ba3e-4187-9554-db7555c582f2 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:17.079800 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:17.085411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e4783a1e-03c4-461c-9723-702377e99b38 tempest-ServerRescueNegativeTestJSON-1656424845 tempest-ServerRescueNegativeTestJSON-1656424845-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:17.131825 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=b62764e4-ba3e-4187-9554-db7555c582f2,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:17.136202 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:17.209509 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] No DVR routers for this DVR port b62764e4-ba3e-4187-9554-db7555c582f2 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:17.212535 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:17.215173 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'name': 'network-vif-deleted', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:52:17.231431 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-a2de6859-6340-4dbd-8a06-be7371537e26 req-b45c5952-fec7-47ec-b741-6875f8efcb05 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "DELETE /v2.0/ports/b62764e4-ba3e-4187-9554-db7555c582f2 HTTP/1.1" status: 204 len: 173 time: 0.6420901 May 25 15:52:17.249787 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-692a1ef3-7c4d-4128-9e39-44a0ded005dd req-1ced6183-17a5-4b3e-9cb5-e591a37fe1fe tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 210 time: 0.0446842 May 25 15:52:17.262221 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '727f4c83-6a75-4ccf-9f52-c2a83ecca801', 'name': 'network-vif-deleted', 'tag': 'b62764e4-ba3e-4187-9554-db7555c582f2', 'status': 'completed', 'code': 200} May 25 15:52:18.026574 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-5ce305b2-47fa-4f7c-89c0-0afce0f2c245 service neutron] 10.222.0.70 "GET /v2.0/ports?device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0442195 May 25 15:52:18.153007 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-e14523de-34ac-43ae-8cc3-4ca7d3fd2d37 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=727f4c83-6a75-4ccf-9f52-c2a83ecca801 HTTP/1.1" status: 200 len: 210 time: 0.0428758 May 25 15:52:18.309710 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-bd3b230c-2371-4bd7-ac73-c31934891024 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:18.311172 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-bd3b230c-2371-4bd7-ac73-c31934891024 service neutron] 10.222.0.70 "GET /v2.0/networks?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1354556 May 25 15:52:18.552582 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-b6663851-ca97-4f04-b9f3-04f5c464fe02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:18.554026 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-12dac259-7cd4-42b9-94f1-b86be5d06c25 req-b6663851-ca97-4f04-b9f3-04f5c464fe02 service neutron] 10.222.0.70 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2357171 May 25 15:52:20.042984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b62764e4-ba3e-4187-9554-db7555c582f2 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:20.078651 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: b62764e4-ba3e-4187-9554-db7555c582f2 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:20.078931 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device b62764e4-ba3e-4187-9554-db7555c582f2 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:20.758996 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51646) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:21.029289 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port 79495442-8f3c-4bab-8e8a-579aac2d2b66 {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:21.029683 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:21.159576 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:21.159932 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:21.283684 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for 79495442-8f3c-4bab-8e8a-579aac2d2b66 owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:21.405077 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:21.409397 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-2fad0fde-aa27-422b-891a-def174fd83d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:21.450584 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=79495442-8f3c-4bab-8e8a-579aac2d2b66,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:21.454033 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:21.545970 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:21.546301 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.db.l3_db [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Floating IP 87abb731-2ba6-407d-b27b-3addb54ec28c disassociated (deleted). External IP: 172.27.0.89, port: 241b07d8-fed4-43ac-a7e1-530b98daf731. May 25 15:52:21.889149 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98463) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:52:22.169541 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98463) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:52:22.179764 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:52:22.185696 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:22.188977 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:22.189613 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:22.244454 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-e65396e6-32c1-49c5-951d-f48c9f87abb0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /v2.0/floatingips/87abb731-2ba6-407d-b27b-3addb54ec28c HTTP/1.1" status: 204 len: 168 time: 1.4842036 May 25 15:52:22.245261 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731'}] {{(pid=98463) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:52:22.309074 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'status': 'completed', 'code': 200} May 25 15:52:22.392673 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:22.439321 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-c51012b1-5571-4ffa-b952-cf477e350949 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:22.440958 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-c51012b1-5571-4ffa-b952-cf477e350949 service neutron] 10.222.0.70 "GET /v2.0/ports?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 1099 time: 0.1017761 May 25 15:52:22.671484 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-6ae79f39-0b8b-46b1-a111-22c1a7158ef0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:22.673146 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-6ae79f39-0b8b-46b1-a111-22c1a7158ef0 service neutron] 10.222.0.70 "GET /v2.0/networks?id=d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 200 len: 912 time: 0.2249496 May 25 15:52:22.731273 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:22.735970 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:52:22.746069 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:22.746818 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:22.756863 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-87edb76d-699a-4dfa-8032-d9d63a7f446a service neutron] 10.222.0.70 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 200 len: 217 time: 0.0703692 May 25 15:52:22.772851 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5626412f-939f-48e1-995c-5d01f37d46f2 req-0ae5f1e6-2a1c-458c-a82f-d312bdac4ee0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:22.773703 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-5626412f-939f-48e1-995c-5d01f37d46f2 req-0ae5f1e6-2a1c-458c-a82f-d312bdac4ee0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:52:22.836855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.quota.resource [req-5626412f-939f-48e1-995c-5d01f37d46f2 req-0ae5f1e6-2a1c-458c-a82f-d312bdac4ee0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98462) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:52:22.838014 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5626412f-939f-48e1-995c-5d01f37d46f2 req-0ae5f1e6-2a1c-458c-a82f-d312bdac4ee0 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.2206836 May 25 15:52:22.843515 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-f81d4616-9d60-41d4-8e04-1b23ddc86e61 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:22.844976 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-f81d4616-9d60-41d4-8e04-1b23ddc86e61 service neutron] 10.222.0.70 "GET /v2.0/subnets?id=693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 200 len: 850 time: 0.0686312 May 25 15:52:22.942679 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-5626412f-939f-48e1-995c-5d01f37d46f2 req-67f1b8d9-ca04-4bb1-b4ca-ce96001aaff7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0967507 May 25 15:52:22.959617 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-bc51a584-d5c8-4fdf-84e3-2d4d13787950 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:22.961214 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-bc51a584-d5c8-4fdf-84e3-2d4d13787950 service neutron] 10.222.0.70 "GET /v2.0/ports?network_id=d8a04926-b628-40fa-a53b-51df7783813d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0996578 May 25 15:52:22.975920 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:23.096281 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-bc6c67d1-25c7-4e41-9870-b1b24c33d582 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1267467 May 25 15:52:23.233131 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-d24e2e9b-a805-4d0b-860f-41bb3342749f req-1b8720ac-a79d-4604-a894-78e14f60e8d1 service neutron] 10.222.0.70 "GET /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1290722 May 25 15:52:23.292398 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:23.296302 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f17ee583-4364-41ec-bad3-33f3f71a7094 None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:42:26Z', 'revision_number': 4, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi', '_interfaces': [{'id': 'f20d30cd-8fa6-4272-bdec-eea7e76d7cf3', 'name': '', 'network_id': 'd8a04926-b628-40fa-a53b-51df7783813d', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'mac_address': 'fa:16:3e:9b:f6:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_interface', 'standard_attr_id': 392, 'fixed_ips': [{'subnet_id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:25Z', 'updated_at': '2021-05-25T15:42:34Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'subnets': [{'id': '693414b7-eaf3-4626-b7cd-b644e55f5f70', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:52:23.489260 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fb69230-3f04-4856-aec2-5a0c022dee44 None None] New status for floating IP 87abb731-2ba6-407d-b27b-3addb54ec28c: DOWN {{(pid=98465) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 15:52:23.601473 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-9e90059e-eb7e-49f5-8944-aabc6c0228e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98462) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:23.602925 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-9e90059e-eb7e-49f5-8944-aabc6c0228e2 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.0813384 May 25 15:52:23.754642 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port 241b07d8-fed4-43ac-a7e1-530b98daf731 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:23.755007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:23.900224 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] For port 241b07d8-fed4-43ac-a7e1-530b98daf731, host hv-cinder-79123, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79123',level=0,port_id=241b07d8-fed4-43ac-a7e1-530b98daf731,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:23.900500 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:24.032969 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for 241b07d8-fed4-43ac-a7e1-530b98daf731 owned by compute:nova {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:24.136277 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb269448-7d9c-44a0-a62c-7f19abb1f85d req-51ee2ac6-d202-4234-b209-4ae30ddc73a7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=98463) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 15:52:24.136970 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-bb269448-7d9c-44a0-a62c-7f19abb1f85d req-51ee2ac6-d202-4234-b209-4ae30ddc73a7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Synchronizing usage tracker for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 15:52:24.145773 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:24.150713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [req-bb269448-7d9c-44a0-a62c-7f19abb1f85d req-51ee2ac6-d202-4234-b209-4ae30ddc73a7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Unset dirty status for tenant:8dff1003ceba47f6a75b4c3901343b7b on resource:port {{(pid=98463) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 15:52:24.151813 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bb269448-7d9c-44a0-a62c-7f19abb1f85d req-51ee2ac6-d202-4234-b209-4ae30ddc73a7 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/ports?device_id=872c3577-4aec-4d1b-bcba-583bdbea50cb HTTP/1.1" status: 200 len: 946 time: 0.0980494 May 25 15:52:24.151982 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-26850a1c-b699-4c17-aac2-fb3f69e7aae0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:24.196498 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [req-bb269448-7d9c-44a0-a62c-7f19abb1f85d req-184cb3b2-01d1-4d8f-9bb0-8e670682bcb1 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "GET /v2.0/security-groups?id=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387084 May 25 15:52:24.196796 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=241b07d8-fed4-43ac-a7e1-530b98daf731,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:24.199951 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:24.358570 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] No DVR routers for this DVR port 241b07d8-fed4-43ac-a7e1-530b98daf731 on host hv-cinder-79123 {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:24.360983 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for port, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:24.363415 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'name': 'network-vif-deleted', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731'}] {{(pid=98462) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 15:52:24.379097 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [req-132a90d3-2c84-4d07-b3d7-426ca6b89458 req-d8259a14-4cfe-4f64-8f4f-6729ed35f492 tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.70 "DELETE /v2.0/ports/241b07d8-fed4-43ac-a7e1-530b98daf731 HTTP/1.1" status: 204 len: 173 time: 0.7696445 May 25 15:52:24.409820 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '872c3577-4aec-4d1b-bcba-583bdbea50cb', 'name': 'network-vif-deleted', 'tag': '241b07d8-fed4-43ac-a7e1-530b98daf731', 'status': 'completed', 'code': 200} May 25 15:52:25.300259 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51688) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:25.516102 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Deleting port 90e5e0be-ef04-40ef-92cb-04a7a801dcdf {{(pid=98463) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:25.516436 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:25.631819 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:25.632174 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:25.667114 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:52:25.751463 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.plugins.ml2.plugin [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Calling delete_port for 90e5e0be-ef04-40ef-92cb-04a7a801dcdf owned by network:floatingip {{(pid=98463) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:25.859736 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1839644'] for port, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:25.864052 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-3713cba5-1809-4da0-8c7d-0f5b29e6461a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:25.943713 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'Port': ['ID=90e5e0be-ef04-40ef-92cb-04a7a801dcdf,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:25.950147 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.007293 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for floatingip, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.020970 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-254235'] for floatingip, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.022071 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-df7ed017-bb26-4649-b1bc-e61ba3576bca tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /v2.0/floatingips/fcc4b2ad-6d1e-47cc-afca-54889bbe1bf4 HTTP/1.1" status: 204 len: 168 time: 0.7207375 May 25 15:52:26.388380 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51706) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:26.506146 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Notify callbacks [] for security_group, before_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.524059 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 15:52:26.528031 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Usage tracker for resource:security_group_rule and tenant:3228257b9a5d46ba9631e06d5d7d21db is out of sync, need to count used quota {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 15:52:26.530785 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.quota.resource [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=98463) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 15:52:26.536549 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.db.quota.driver [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=98463) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 15:52:26.623120 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.626949 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_create {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.635168 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-42f2c0b1-6794-4aa8-aad3-3453e6755c65 tempest-AttachVolumeTestJSON-1528071049 tempest-AttachVolumeTestJSON-1528071049-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.674479 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=3228257b9a5d46ba9631e06d5d7d21db&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2850742 May 25 15:52:26.675493 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b810437d-3a47-4f5f-8af1-24018133c528,revision_number=1']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:26.677262 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51712) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:26.678699 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-5e85a594-e9f2-417d-bccf-7a71d88e4943 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.736411 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.761801 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.816805 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.820869 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c7ec1a13-f4ec-490c-8dcb-2506be0f4440 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:26.832243 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b810437d-3a47-4f5f-8af1-24018133c528,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:26.834649 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:26.841046 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:26.842150 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e7f4f364-c067-4471-807e-bf45c4b93eb8 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/b810437d-3a47-4f5f-8af1-24018133c528 HTTP/1.1" status: 204 len: 168 time: 0.1628137 May 25 15:52:27.402674 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51720) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:27.468896 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:27.497878 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:27.566208 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:27.572471 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-0ac2208c-b727-429a-9812-92c853167eda admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:27.588484 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:27.591151 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:27.600519 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:27.601639 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-64b99924-1229-408d-b8c7-489b551f139a tempest-TestVolumeBootPattern-1824914249 tempest-TestVolumeBootPattern-1824914249-project] 10.222.0.36 "DELETE /v2.0/security-groups/1cf9f4a2-3a7a-4f0d-a572-507c1d4fd1fb HTTP/1.1" status: 204 len: 168 time: 0.1980088 May 25 15:52:27.664498 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51726) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:28.073048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 241b07d8-fed4-43ac-a7e1-530b98daf731 no longer exists at agent hyperv_hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:28.106907 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] No Port match for: 241b07d8-fed4-43ac-a7e1-530b98daf731 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:28.107261 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Device 241b07d8-fed4-43ac-a7e1-530b98daf731 not bound to the agent host hv-cinder-79123 {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:28.354859 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:28.758299 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Deleting port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:28.758637 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:28.877855 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] For port f20d30cd-8fa6-4272-bdec-eea7e76d7cf3, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:28.878209 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:29.003402 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Calling delete_port for f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 owned by network:router_interface {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:29.239682 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:29.244605 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-d90f42c5-c18d-43cc-b627-566acb7150d2 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:29.288674 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Pushing event deleted for resources: {'Port': ['ID=f20d30cd-8fa6-4272-bdec-eea7e76d7cf3,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:29.292144 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:29.553315 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:29.908107 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Router 96a94b7a-1c97-4304-a42c-09cef968898f has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:52:29.986336 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7b2022d3-7661-4eff-b569-147ec93c8a48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:30.097807 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:52:30.106789 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Sync routers for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:52:30.111598 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-357cc5cf-f7ee-416d-b0c5-e0c9728731bc admin admin] 10.222.0.36 "PUT /v2.0/routers/96a94b7a-1c97-4304-a42c-09cef968898f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4459722 May 25 15:52:30.112931 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51732) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:30.115674 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:30.116319 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:30.289689 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:30.294751 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: dv-cinder-791239-3-iscsi {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:30.572969 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:30.588849 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:52:29Z', 'revision_number': 5, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port': {'id': '4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:47:69:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 391, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:22Z', 'updated_at': '2021-05-25T15:42:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:30.592751 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Checking router: 96a94b7a-1c97-4304-a42c-09cef968898f for host: dv-cinder-791239-3-iscsi {{(pid=98464) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:52:30.601160 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Routers {'96a94b7a-1c97-4304-a42c-09cef968898f'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98464) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:30.601769 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:03Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['96a94b7a-1c97-4304-a42c-09cef968898f'], 'active': True} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:30.644775 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Deleting port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:30.645105 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:30.753856 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvr_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] Set router 96a94b7a-1c97-4304-a42c-09cef968898f gateway port host: None {{(pid=98464) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:30.763747 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] For port 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:30.764136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:30.859579 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_hamode_db [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:52:30Z', 'revision_number': 6, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98464) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:30.863359 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd29ea5b-2ef6-41b3-b2a7-629a0a3d807c None None] The sync data for ids ['96a94b7a-1c97-4304-a42c-09cef968898f'] in dv-cinder-791239-3-iscsi is: [{'id': '96a94b7a-1c97-4304-a42c-09cef968898f', 'name': 'tempest-TestVolumeBootPattern-126237461-router', 'tenant_id': '8dff1003ceba47f6a75b4c3901343b7b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:21Z', 'updated_at': '2021-05-25T15:52:30Z', 'revision_number': 6, 'project_id': '8dff1003ceba47f6a75b4c3901343b7b', 'gw_port_host': None}] {{(pid=98464) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:52:30.887896 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Calling delete_port for 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:31.028212 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.032917 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-6cc17d48-cac2-4326-b865-76211ea0573c tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:31.105620 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Pushing event deleted for resources: {'Port': ['ID=4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:31.107922 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:31.171578 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.349557 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.351725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.374624 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.375057 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 96a94b7a-1c97-4304-a42c-09cef968898f {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:52:31.387109 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.388260 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-19cf906c-0f55-4a39-abff-f642ceb34b47 admin admin] 10.222.0.36 "DELETE /v2.0/routers/96a94b7a-1c97-4304-a42c-09cef968898f HTTP/1.1" status: 204 len: 168 time: 1.2744200 May 25 15:52:31.390770 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51736) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:31.451524 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Deleting subnet 693414b7-eaf3-4626-b7cd-b644e55f5f70 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:52:31.454405 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.505049 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.580856 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.642506 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:31.676975 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:31.677334 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 4acd8131-d5cb-4ca3-8b3d-d5cd43ebbe40 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:31.677764 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:31.711556 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:31.711884 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device f20d30cd-8fa6-4272-bdec-eea7e76d7cf3 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:31.836678 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.841176 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:31.876064 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=693414b7-eaf3-4626-b7cd-b644e55f5f70,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:31.877984 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:31.880771 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:31.883008 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-72946a67-fdfc-4937-85fa-1cb79797e0e7 None None] Network d8a04926-b628-40fa-a53b-51df7783813d requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:52:31.885334 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-30059bdc-4caf-4130-99bc-830007b52c6f admin admin] 10.222.0.36 "DELETE /v2.0/subnets/693414b7-eaf3-4626-b7cd-b644e55f5f70 HTTP/1.1" status: 204 len: 168 time: 0.4930003 May 25 15:52:31.887537 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51740) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:32.002899 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.074482 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Deleting port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:32.074831 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.193083 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] DHCP port deletion for d8a04926-b628-40fa-a53b-51df7783813d request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:52:32.256559 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Deleting port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:32.256931 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.273927 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] For port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:32.274292 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.357356 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] For port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,segment=NetworkSegment(bbec2705-fa86-48c1-842e-d80e8691ed54),segment_id=bbec2705-fa86-48c1-842e-d80e8691ed54)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:32.357757 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.402340 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Calling delete_port for 12fb5763-2454-41d1-b8b5-dc1bb2189f3d owned by network:dhcp {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:32.450186 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.454934 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-8e83d20b-9911-4fd1-8f2f-a87d1d9b8a61 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:32.483905 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Calling delete_port for 12fb5763-2454-41d1-b8b5-dc1bb2189f3d owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:32.499521 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] No DVR routers for this DVR port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d on host dv-cinder-791239-3-iscsi {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:32.527017 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.528347 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Pushing event deleted for resources: {'Port': ['ID=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:32.530657 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:32.531421 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:32.572848 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Pushing event deleted for resources: {'Port': ['ID=12fb5763-2454-41d1-b8b5-dc1bb2189f3d,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:32.577592 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] No DVR routers for this DVR port 12fb5763-2454-41d1-b8b5-dc1bb2189f3d on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:32.583510 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.583875 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.584222 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.584559 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.584920 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.585254 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.585583 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.585908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.586313 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.586547 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.586870 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.587190 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-791239-3-iscsi {{(pid=98464) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 15:52:32.590820 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-057c9c87-7d85-4c6d-a121-fc5faf5c082e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:32.620539 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.633280 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d8a04926-b628-40fa-a53b-51df7783813d']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:32.646051 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bbec2705-fa86-48c1-842e-d80e8691ed54') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:32.646338 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bbec2705-fa86-48c1-842e-d80e8691ed54') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:32.652845 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.658887 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.674737 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.681070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Releasing vlan 377 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:52:32.681945 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:52:32.695435 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:52:32.698498 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a96da69d-1f95-45c9-a0d6-d4dfbffe22ad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.773394 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.776994 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-32dd0b6b-2a5e-4556-b9ee-521e7028ec46 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:32.789514 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:32.799291 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Pushing event deleted for resources: {'Network': ['ID=d8a04926-b628-40fa-a53b-51df7783813d,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:32.803309 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:32.807455 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] 10.222.0.36 "DELETE /v2.0/networks/d8a04926-b628-40fa-a53b-51df7783813d HTTP/1.1" status: 204 len: 168 time: 0.9189754 May 25 15:52:32.810356 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51744) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:33.341849 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-761894'] for router_interface, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:33.486507 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:33.581398 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 12fb5763-2454-41d1-b8b5-dc1bb2189f3d no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:33.616643 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 12fb5763-2454-41d1-b8b5-dc1bb2189f3d {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:33.616908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 12fb5763-2454-41d1-b8b5-dc1bb2189f3d not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:33.843622 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Deleting port 10ebe78a-0a5b-491d-9a8f-7eba3de16144 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:33.844205 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:33.966024 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] For port 10ebe78a-0a5b-491d-9a8f-7eba3de16144, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=10ebe78a-0a5b-491d-9a8f-7eba3de16144,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:33.966283 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:34.086125 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Calling delete_port for 10ebe78a-0a5b-491d-9a8f-7eba3de16144 owned by network:router_interface {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:34.229561 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:34.232866 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-4d425ae9-9a58-4c12-b521-b88254f2d712 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:34.277136 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Pushing event deleted for resources: {'Port': ['ID=10ebe78a-0a5b-491d-9a8f-7eba3de16144,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:34.310879 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:34.545828 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-585452', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-764086'] for router_interface, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:34.908307 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Router e827d150-1d40-48ae-a517-391faf4f7fb9 has already been hosted by L3 agent bca50bfd-8ae1-46a3-855b-6504e7cffb32 {{(pid=98462) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 15:52:35.181183 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] Notify agent at l3_agent.dv-cinder-791239-3-iscsi the message routers_updated {{(pid=98462) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 15:52:35.190307 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Sync routers for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 15:52:35.200432 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-24d299b4-33a5-4534-8bbe-419a968a51b8 admin admin] 10.222.0.36 "PUT /v2.0/routers/e827d150-1d40-48ae-a517-391faf4f7fb9/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3867962 May 25 15:52:35.200709 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51748) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:35.202882 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:35.203456 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:35.211116 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.376673 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks [] for router, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.378962 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: dv-cinder-791239-3-iscsi {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:35.555208 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.634861 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Deleting port 9705bc2e-e543-4e21-885a-cbfd97ffff91 {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:35.635219 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.660024 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'external_fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67'}], 'enable_snat': True}, 'gw_port_id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:52:34Z', 'revision_number': 5, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port': {'id': '9705bc2e-e543-4e21-885a-cbfd97ffff91', 'name': '', 'network_id': '5faa42c5-bc4c-4066-864c-fb4aa8b3c7da', 'tenant_id': '', 'mac_address': 'fa:16:3e:6a:6c:9b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 416, 'fixed_ips': [{'subnet_id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'ip_address': '172.27.0.67', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-791239-3-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:42:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'ffbac48b-f0bf-4296-959e-36eeb4ffe30f', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-791239-3-iscsi'}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:35.663795 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Checking router: e827d150-1d40-48ae-a517-391faf4f7fb9 for host: dv-cinder-791239-3-iscsi {{(pid=98465) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 15:52:35.672278 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvrscheduler_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Routers {'e827d150-1d40-48ae-a517-391faf4f7fb9'} bound to L3 agent in host dv-cinder-791239-3-iscsi {{(pid=98465) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 15:52:35.672874 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-791239-3-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T15:32:03Z,description=,heartbeat_timestamp=2021-05-25T15:52:33Z,host='dv-cinder-791239-3-iscsi',id=bca50bfd-8ae1-46a3-855b-6504e7cffb32,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T15:32:03Z,topic='l3_agent')) {'router_ids': ['e827d150-1d40-48ae-a517-391faf4f7fb9'], 'active': True} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:35.756939 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] For port 9705bc2e-e543-4e21-885a-cbfd97ffff91, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=9705bc2e-e543-4e21-885a-cbfd97ffff91,segment=NetworkSegment(68db3f28-5dc9-4720-b834-2eec1a899865),segment_id=68db3f28-5dc9-4720-b834-2eec1a899865)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:35.757300 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:35.824026 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_dvr_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] Set router e827d150-1d40-48ae-a517-391faf4f7fb9 gateway port host: None {{(pid=98465) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 15:52:35.881171 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Calling delete_port for 9705bc2e-e543-4e21-885a-cbfd97ffff91 owned by network:router_gateway {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:35.923351 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.l3_hamode_db [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:52:35Z', 'revision_number': 6, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port_host': None}], 'dv-cinder-791239-3-iscsi', False) {} {{(pid=98465) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:35.927196 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-24db82f8-03b7-40be-967f-322c0b82efbd None None] The sync data for ids ['e827d150-1d40-48ae-a517-391faf4f7fb9'] in dv-cinder-791239-3-iscsi is: [{'id': 'e827d150-1d40-48ae-a517-391faf4f7fb9', 'name': 'tempest-TestVolumeBootPattern-864094690-router', 'tenant_id': 'dd417f7ce220428a8ac4019081a23f62', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T15:42:30Z', 'updated_at': '2021-05-25T15:52:35Z', 'revision_number': 6, 'project_id': 'dd417f7ce220428a8ac4019081a23f62', 'gw_port_host': None}] {{(pid=98465) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 15:52:36.024868 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.028567 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-c108faba-8de7-4ef1-810a-5a103b97e450 tempest-AttachVolumeNegativeTest-2033873450 tempest-AttachVolumeNegativeTest-2033873450-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:36.072629 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Pushing event deleted for resources: {'Port': ['ID=9705bc2e-e543-4e21-885a-cbfd97ffff91,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:36.075076 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:36.164593 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-762939'] for router_gateway, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.342395 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-765878', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-130869'] for router, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.344689 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.367569 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-764298'] for router, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.368109 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router e827d150-1d40-48ae-a517-391faf4f7fb9 {{(pid=98462) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 15:52:36.380304 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] Notify callbacks [] for router, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.381416 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-7fd757f4-0b3c-473c-a811-fc629d8e61c5 admin admin] 10.222.0.36 "DELETE /v2.0/routers/e827d150-1d40-48ae-a517-391faf4f7fb9 HTTP/1.1" status: 204 len: 168 time: 1.1797595 May 25 15:52:36.384004 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51752) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:36.442606 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.db_base_plugin_v2 [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Deleting subnet 106540a5-17af-46aa-898b-cb892e5429a3 {{(pid=98462) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 15:52:36.445410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.590939 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-10984263'] for subnet, precommit_delete_associations {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.668072 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3907018'] for subnet, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.924039 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3905919', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90657', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-1633434', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-10881177'] for subnet, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.928200 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-a7ba403d-6494-4415-899a-48bcdb214645 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:36.962293 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=106540a5-17af-46aa-898b-cb892e5429a3,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:36.965894 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:36.966897 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for subnet, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:36.972697 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-5d5a35d7-19c1-444f-b9cf-78388a3db4c5 admin admin] 10.222.0.36 "DELETE /v2.0/subnets/106540a5-17af-46aa-898b-cb892e5429a3 HTTP/1.1" status: 204 len: 168 time: 0.5877268 May 25 15:52:36.973078 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c20d269c-2f74-4c96-8f79-c24c323a7f94 None None] Network 2c5e4839-a841-4a46-935d-db737f3897d3 requested from dv-cinder-791239-3-iscsi {{(pid=98464) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 15:52:36.975053 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51756) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:37.081389 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3883198'] for network, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.152121 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Deleting port 87367c2c-8deb-4499-a4e7-a512bc3f3daf {{(pid=98462) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:37.152352 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.214968 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] DHCP port deletion for 2c5e4839-a841-4a46-935d-db737f3897d3 request from dv-cinder-791239-3-iscsi {{(pid=98464) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 15:52:37.254124 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.db [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] For port 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=87367c2c-8deb-4499-a4e7-a512bc3f3daf,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98462) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:37.254488 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.280905 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Deleting port 87367c2c-8deb-4499-a4e7-a512bc3f3daf {{(pid=98464) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 15:52:37.281290 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8752734187587'] for port, before_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.376771 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.db [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] For port 87367c2c-8deb-4499-a4e7-a512bc3f3daf, host dv-cinder-791239-3-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-791239-3-iscsi',level=0,port_id=87367c2c-8deb-4499-a4e7-a512bc3f3daf,segment=NetworkSegment(c0847609-0609-4583-9f09-a85fe37bef18),segment_id=c0847609-0609-4583-9f09-a85fe37bef18)] {{(pid=98464) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 15:52:37.377177 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-763895'] for port, precommit_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.381895 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.plugin [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Calling delete_port for 87367c2c-8deb-4499-a4e7-a512bc3f3daf owned by network:dhcp {{(pid=98462) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:37.429105 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-1998697'] for port, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.433776 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-f28d2fd9-8c46-4dbe-9a86-c9e45bd98b52 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:37.476410 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Pushing event deleted for resources: {'Port': ['ID=87367c2c-8deb-4499-a4e7-a512bc3f3daf,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:37.479911 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:37.480701 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.db.l3_dvrscheduler_db [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] No DVR routers for this DVR port 87367c2c-8deb-4499-a4e7-a512bc3f3daf on host dv-cinder-791239-3-iscsi {{(pid=98462) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:37.506250 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Calling delete_port for 87367c2c-8deb-4499-a4e7-a512bc3f3daf owned by network:dhcp {{(pid=98464) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 15:52:37.552205 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3735505', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-90713', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-585470', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8752734189478', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8752733804764'] for port, after_delete {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.557287 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:37.596436 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 10ebe78a-0a5b-491d-9a8f-7eba3de16144 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:37.601518 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3904069', 'neutron.services.segments.db._delete_segments_for_network-8752734249436'] for network, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.614772 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c5e4839-a841-4a46-935d-db737f3897d3']}} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:37.627163 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c0847609-0609-4583-9f09-a85fe37bef18') {'for_net_delete': True} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:37.627463 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.services.segments.db [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c0847609-0609-4583-9f09-a85fe37bef18') {} {{(pid=98462) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 15:52:37.631769 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Pushing event deleted for resources: {'Port': ['ID=87367c2c-8deb-4499-a4e7-a512bc3f3daf,revision_number=None']} {{(pid=98464) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:37.634451 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG oslo_concurrency.lockutils [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=98464) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:37.638906 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8752734259357', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-10984268'] for segment, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.641261 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92a53d98-b940-43fb-a04f-e835b51a2b5b None None] No DVR routers for this DVR port 87367c2c-8deb-4499-a4e7-a512bc3f3daf on host dv-cinder-791239-3-iscsi {{(pid=98464) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 15:52:37.642791 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 10ebe78a-0a5b-491d-9a8f-7eba3de16144 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:37.643141 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 10ebe78a-0a5b-491d-9a8f-7eba3de16144 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:37.643806 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 87367c2c-8deb-4499-a4e7-a512bc3f3daf no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:37.655818 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477'] for segment, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.662148 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Releasing vlan 394 on physical network physnet1 to pool {{(pid=98462) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 15:52:37.662535 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3892477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-1998652'] for segment, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: Traceback (most recent call last): May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: timer() May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: cb(*args, **kw) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: return func(*args, **kwargs) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: self._notify() May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: self.callback(batched_events) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: event.method(event) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: aggregate_uuid = self.p_client.list_aggregates( May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: return f(self, *a, **k) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._get(url).json() May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: return self.request(url, 'GET', **kwargs) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: base_url = self.get_endpoint(auth, allow=allow, May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 15:52:37.675886 dv-cinder-791239-3-iscsi neutron-server[98462]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 15:52:37.680956 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 87367c2c-8deb-4499-a4e7-a512bc3f3daf {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:37.681291 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 87367c2c-8deb-4499-a4e7-a512bc3f3daf not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:37.682215 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 9705bc2e-e543-4e21-885a-cbfd97ffff91 no longer exists at agent ovs-agent-dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 15:52:37.714768 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.plugin [None req-740ee528-6802-4636-8994-2b477d3459bf None None] No Port match for: 9705bc2e-e543-4e21-885a-cbfd97ffff91 {{(pid=98464) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 15:52:37.715123 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron.plugins.ml2.rpc [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Device 9705bc2e-e543-4e21-885a-cbfd97ffff91 not bound to the agent host dv-cinder-791239-3-iscsi {{(pid=98464) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 15:52:37.752371 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3904076', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-555043', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-585445', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-762918'] for network, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.756070 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-720c249a-5204-40e3-a7dd-b492f02d1d80 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:37.769219 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-585408'] for network, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:37.781424 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Pushing event deleted for resources: {'Network': ['ID=2c5e4839-a841-4a46-935d-db737f3897d3,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:37.785662 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:37.789059 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-905a307d-f909-4830-bc22-be0dc93bea9c admin admin] 10.222.0.36 "DELETE /v2.0/networks/2c5e4839-a841-4a46-935d-db737f3897d3 HTTP/1.1" status: 204 len: 168 time: 0.8130984 May 25 15:52:37.955007 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51762) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:38.003430 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-edf650b4-9ebd-48bc-98be-5f17aaf42864 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=8dff1003ceba47f6a75b4c3901343b7b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0467503 May 25 15:52:38.005725 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [-] (98462) accepted ('10.222.0.36', 51766) {{(pid=98462) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:38.073004 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.099673 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.150918 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.154461 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-482fe135-a68b-40d0-bec3-ea2c4a7067ee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:38.167264 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3c73ab0-a444-4461-afee-53ef51154a1c,revision_number=None']} {{(pid=98462) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:38.170832 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG oslo_concurrency.lockutils [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=98462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:38.175708 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron_lib.callbacks.manager [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98462) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.176855 dv-cinder-791239-3-iscsi neutron-server[98462]: INFO neutron.wsgi [None req-e8f71622-e9fe-4ff9-902c-7688a4b9e736 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/b3c73ab0-a444-4461-afee-53ef51154a1c HTTP/1.1" status: 204 len: 168 time: 0.1702621 May 25 15:52:38.665369 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51774) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:38.717171 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-0d7bb0bb-dc13-428c-8f89-3f999c2fbe75 admin admin] 10.222.0.36 "GET /v2.0/security-groups?tenant_id=dd417f7ce220428a8ac4019081a23f62&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0501688 May 25 15:52:38.719011 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [-] (98463) accepted ('10.222.0.36', 51778) {{(pid=98463) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 15:52:38.776349 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.801173 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.852942 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-555075'] for security_group, after_delete {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.858005 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-6b9bf991-b64a-405c-aa9f-aaef4d061864 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 15:52:38.870222 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4a8d28a-eb64-4931-8b2b-06f58e78a7c8,revision_number=None']} {{(pid=98463) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 15:52:38.873159 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG oslo_concurrency.lockutils [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=98463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 15:52:38.875091 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron_lib.callbacks.manager [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=98463) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:38.876213 dv-cinder-791239-3-iscsi neutron-server[98463]: INFO neutron.wsgi [None req-d94a6ef1-ea87-4c0e-8f0b-439aaca2a4b7 admin admin] 10.222.0.36 "DELETE /v2.0/security-groups/d4a8d28a-eb64-4931-8b2b-06f58e78a7c8 HTTP/1.1" status: 204 len: 168 time: 0.1562870 May 25 15:52:42.727997 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:52:59.988853 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0943b165-7d91-48d0-a272-ca39de7e1717 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:02.655378 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:02.666256 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:53:02.697890 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-861e40d7-e745-40e9-a544-01d43b50b57f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:03.488278 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:05.207908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:12.727245 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:29.989254 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-7483d8b0-9a07-4216-b1a2-ff1d8388b4ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:32.657938 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:32.697172 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8bb58157-3aea-477e-9be7-283b541edbc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:33.491606 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:35.210799 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:39.665105 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:53:42.746984 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:53:59.990929 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-6b1a5c62-d78f-4990-a58d-9ccafd6ba222 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:02.660422 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:02.697465 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1f9e31d9-b543-48b1-9154-98eb2659bbd7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:03.496510 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:05.212654 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:12.757055 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:16.665220 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:54:29.992914 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-c9fb5805-f034-4d05-b38c-948598ad9db7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:32.662371 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:32.699326 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-98b96536-f949-4d73-ae43-39e62589ed8d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:33.497983 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:35.215518 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:42.756652 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:54:53.664759 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:54:59.996740 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-f411dc2c-193e-4f03-8dac-b375827fdcc4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:02.663685 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:02.698552 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-ca8bb2b4-dff6-4f7a-bca6-33e79fb508e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:03.502139 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:05.218240 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:12.763882 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:29.999429 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-1090b40b-5d85-4982-96b5-187776e9a89d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:30.663690 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:55:32.665771 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:32.705298 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-37af05f2-c03f-452e-ab84-094f70722d62 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:33.508104 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:33.853919 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [req-faf7dcaf-48ac-4914-b228-636b12eaf2f0 req-aa532778-5654-4714-9651-2b6fde156fa1 service neutron] (98463) timed out ('10.222.0.70', 61822) {{(pid=98463) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 15:55:35.226052 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:55:42.757732 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:00.004416 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-0d3fcec4-e74b-44ed-840a-4a38dfde2e92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:02.669520 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:02.696206 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-a3cb0aeb-6b14-404f-9ee6-a0b3b22a8ae2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:03.506754 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:05.224429 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:07.387959 dv-cinder-791239-3-iscsi neutron-server[98463]: DEBUG neutron.wsgi [req-c76381df-c7f1-4545-a1c7-f06f03c87f6a req-65c870dd-059f-4d0c-9cc5-58bebdac50e1 service neutron] (98463) timed out ('10.222.0.70', 61856) {{(pid=98463) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 15:56:07.663241 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:56:12.787095 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:30.005949 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-14f9ca16-0312-4662-b691-88e04269049d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:32.672621 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:32.696283 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-5b1fc090-a778-4fab-826b-27b3832f33e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:33.509125 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:35.228242 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:42.788328 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:56:44.662346 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:57:00.007738 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-e9a40769-3270-4561-9a72-67a43243ed2d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:02.673865 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:02.697830 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-55c9fe5d-af79-4d41-a3a0-b3aa22da7715 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:03.511348 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:05.231533 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:12.800908 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:21.662211 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:57:30.009156 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-cd28d900-ab18-4828-8e5b-d0e5721f1c6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:32.676222 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:32.698669 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-977fc143-0f45-4a1b-8c61-ac4daa45c180 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:33.514607 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:35.233665 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:42.824808 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:57:58.661043 dv-cinder-791239-3-iscsi neutron-server[98465]: DEBUG neutron.db.agents_db [None req-1c272ffd-0882-44de-b029-82ac3ef5a2ea None None] Agent healthcheck: found 6 active agents {{(pid=98465) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 15:58:00.012048 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-d837f286-8d0f-4baf-9fba-9684dbe28d77 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:02.678158 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-740ee528-6802-4636-8994-2b477d3459bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:02.699718 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-08c35e5d-0291-47c8-9753-226fa54ef9ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:03.519045 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-3ce04277-4933-4b83-a837-dc8956c83863 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:05.237193 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-b734f0a2-7f26-4e09-b83e-9a6ef682655d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:12.817323 dv-cinder-791239-3-iscsi neutron-server[98464]: DEBUG neutron_lib.callbacks.manager [None req-8a420952-043a-4cd3-b036-5f7c4cb8bb1e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8752734249454', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3902859'] for agent, after_update {{(pid=98464) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 15:58:15.386524 dv-cinder-791239-3-iscsi neutron-server[98462]: DEBUG neutron.wsgi [req-a3267524-a4df-4c24-b4c4-31df832b885c req-d802341f-0746-4c69-9240-575b8807b83e service neutron] (98462) timed out ('10.222.0.70', 61852) {{(pid=98462) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}